00000001:02000400:0.0F:1787853367.640552:0:2953:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_hostid 00000001:02000400:0.0:1787853382.765630:0:3173:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1787853384.719231:0:3237:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 575 MB/s 00000001:01000000:3.0:1787853384.969314:0:3237:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 843 MB/s 00000001:01000000:2.0F:1787853385.218762:0:3237:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4199 MB/s 00000020:02000000:3.0:1787853385.899053:0:3266:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_83_g3de4944 00000400:02000000:3.0:1787853386.633646:0:3281:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.110@tcp [8/256/0/180] 00008000:02000000:3.0:1787853390.343374:0:3430:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0F:1787853436.935019:0:5232:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787853446.860170:0:5806:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787853446.860179:0:5806:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787853446.860301:0:5806:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000003c11661c 00000080:02000400:2.0:1787853446.860315:0:5806:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787853446.868446:0:5806:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787853446.868464:0:5806:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787853446.873558:0:5806:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000a7202f19) 00000020:00000080:2.0:1787853446.873599:0:5806:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787853446.911756:0:5806:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787853446.912181:0:5806:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787853446.988214:0:5806:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787853446.988251:0:5806:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787853446.988270:0:5806:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787853446.988318:0:5806:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787853446.988341:0:5806:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787853446.988774:0:5806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787853446.988784:0:5806:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787853447.000859:0:5806:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf1365f7cb054546 00000020:01000004:3.0:1787853447.000872:0:5806:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787853447.000879:0:5806:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787853447.001203:0:5806:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003c11661c from MGS 00000020:01000004:3.0:1787853447.001210:0:5806:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787853447.001255:0:5806:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000429c0b56) 00000020:00000080:3.0:1787853447.001276:0:5806:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787853447.001823:0:5806:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003c11661c from MGS, refs=2 00080000:01000000:3.0:1787853447.001833:0:5806:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787853447.001851:0:5806:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf1365f7cb054554 00000100:00100000:3.0:1787853447.002016:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787853447.002208:0:5806:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787853447.002215:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787853447.007861:0:5806:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787853447.007875:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787853447.011316:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787853447.014286:0:5806:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787853447.014305:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787853447.019748:0:5806:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787853447.019802:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787853447.030088:0:5806:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787853447.030130:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787853447.033903:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853447.033917:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853447.033920:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853447.034364:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853447.034368:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853447.034370:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853447.036493:0:5806:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787853447.040984:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787853447.286173:0:5806:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2807 MB/s 00000001:01000000:3.0:1787853447.537216:0:5806:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3621 MB/s 00000001:01000000:2.0:1787853447.788128:0:5806:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1083 MB/s 00000001:01000000:2.0:1787853448.037883:0:5806:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1159 MB/s 00080000:10000000:2.0:1787853448.043580:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1787853448.052954:0:5806:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787853448.052974:0:5806:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787853448.052977:0:5806:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787853448.058280:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787853448.058513:0:5806:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787853448.058589:0:5806:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787853448.058991:0:5806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787853448.059024:0:5806:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787853448.059630:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787853448.059960:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787853448.059967:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787853448.061329:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787853448.061343:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787853448.068874:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787853448.068897:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00010000:00010000:0.0:1787853448.070916:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787853448.072302:0:5806:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787853448.072329:0:5806:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.110@tcp' 00000020:01000004:2.0:1787853448.072331:0:5806:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787853448.072395:0:5806:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.110@tcp (typ=mgc) 00000020:00000080:2.0:1787853448.072409:0:5806:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.110@tcp (000000005957a43a) 00000020:00000080:2.0:1787853448.072431:0:5806:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787853448.072555:0:5806:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000025d43626@MGC192.168.206.110@tcp: add connection 192.168.206.110@tcp at head 00000100:00080000:1.0:1787853448.072912:0:5820:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:2.0:1787853448.073313:0:5806:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.110@tcp-0 is initialized 00000040:01000000:2.0:1787853448.073322:0:5806:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787853448.074452:0:5821:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787853448.074866:0:5806:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.110@tcp (uuid c912fdd2-2ba1-4aef-9721-e9a024331fd8) 00000020:00000080:2.0:1787853448.074896:0:5806:0:(genops.c:1385:class_connect()) connect: client c912fdd2-2ba1-4aef-9721-e9a024331fd8, cookie 0xcf1365f7cb054562 00000100:00080000:2.0:1787853448.074911:0:5806:0:(import.c:510:import_select_connection()) MGC192.168.206.110@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787853448.074918:0:5806:0:(import.c:624:import_select_connection()) MGC192.168.206.110@tcp: import 0000000025d43626 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:2.0:1787853448.074959:0:5806:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c05b6ddc x1874700152078464/t0(0) o250->MGC192.168.206.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787853448.076068:0:5806:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c912fdd2-2ba1-4aef-9721-e9a024331fd8->MGS 00000020:01000004:2.0:1787853448.076229:0:5806:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787853448.076236:0:5806:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787853448.076254:0:5806:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000000e767c9) 00000020:00000080:2.0:1787853448.076278:0:5806:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787853448.077409:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c05b6ddc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3296:1874700152078464:0@lo:250: 00000100:00100000:0.0:1787853448.077501:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853448.083547:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152078464 00000100:00100000:3.0:1787853448.083570:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152078464 00000100:00100000:3.0:1787853448.083623:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853448.083632:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d64272bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3296:x1874700152078464:12345-0@lo:250: 00010000:00080000:3.0:1787853448.083668:0:5816:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from c912fdd2-2ba1-4aef-9721-e9a024331fd8@0@lo t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:3.0:1787853448.083721:0:5816:0:(genops.c:1385:class_connect()) connect: client c912fdd2-2ba1-4aef-9721-e9a024331fd8, cookie 0xcf1365f7cb054570 00000100:00080000:3.0:1787853448.100425:0:5816:0:(import.c:65:import_set_state_nolock()) 000000008aa8ff8e : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787853448.100549:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d64272bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+5:3296:x1874700152078464:12345-0@lo:250: Request processed in 16916us (23046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853448.100562:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787853448.101203:0:3296:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.110@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787853448.101215:0:3296:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.110@tcp: connect to target with instance 0 00000100:00080000:1.0:1787853448.101225:0:3296:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.110@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787853448.101230:0:3296:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787853448.101234:0:3296:0:(import.c:65:import_set_state_nolock()) 0000000025d43626 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787853448.101237:0:3296:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787853448.101254:0:3296:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787853448.101260:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c05b6ddc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3296:1874700152078464:0@lo:250: 00000100:00100000:3.0:1787853448.127366:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787853448.130668:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787853448.130712:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787853448.134252:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787853448.134271:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787853448.134775:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787853448.134784:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787853448.136740:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787853448.136969:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787853448.136993:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787853448.145171:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787853448.145190:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787853448.247394:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787853448.248399:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787853448.248408:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787853448.250203:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787853448.250217:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787853448.252449:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787853448.253031:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787853448.253039:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787853448.257311:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787853448.257352:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787853448.260353:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787853448.260594:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787853448.260608:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787853448.266519:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787853448.266538:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787853448.267975:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787853448.268221:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787853448.268226:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787853448.277969:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787853448.277993:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787853448.316322:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787853448.316572:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787853448.316897:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787853448.320120:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787853448.320139:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787853448.322058:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787853448.322086:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787853448.324507:0:5806:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787853448.324553:0:5806:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787853448.324560:0:5806:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.110@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787853448.324957:0:5806:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787853448.325002:0:5806:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.110@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787853448.325007:0:5806:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787853448.325009:0:5806:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787853448.325010:0:5806:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787853448.325012:0:5806:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787853448.325013:0:5806:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787853448.325021:0:5806:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787853448.325022:0:5806:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787853448.325023:0:5806:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787853448.325024:0:5806:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787853448.325026:0:5806:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787853448.325027:0:5806:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787853448.325028:0:5806:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787853448.325031:0:5806:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787853448.325033:0:5806:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787853448.325034:0:5806:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787853448.325035:0:5806:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787853448.325036:0:5806:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787853448.325037:0:5806:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787853448.325038:0:5806:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787853448.325039:0:5806:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787853448.325040:0:5806:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787853448.325041:0:5806:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787853448.325041:0:5806:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787853448.325042:0:5806:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787853448.325043:0:5806:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787853448.325158:0:5806:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787853448.325181:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcb1f6be pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152078592:0@lo:253: 00000100:00100000:2.0:1787853448.325291:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853448.325390:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e4f7a25 going to sleep for 11 seconds 00000100:00100000:0.0:1787853448.325510:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152078592 00000100:00100000:0.0:1787853448.325520:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152078592 00000100:00100000:0.0:1787853448.325699:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787853448.325708:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005de0c8fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+5:5806:x1874700152078592:12345-0@lo:253: 20000000:01000000:0.0:1787853448.325757:0:5819:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787853448.325760:0:5819:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1787853448.326203:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787853448.326270:0:5819:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787853448.326757:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787853448.327954:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787853448.328286:0:5819:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787853448.328292:0:5819:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787853448.328298:0:5819:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787853448.328301:0:5819:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787853448.328317:0:5819:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787853448.328537:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787853448.329301:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787853448.329321:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787853448.329373:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787853448.329425:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787853448.329463:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787853448.329564:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787853448.329573:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787853448.329780:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787853448.329790:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787853448.329825:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787853448.329832:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787853448.329865:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787853448.329934:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787853448.329970:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787853448.329976:0:5819:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787853448.329989:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787853448.330278:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787853448.330289:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787853448.330324:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787853448.330356:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787853448.330397:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787853448.330407:0:5819:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787853448.330471:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787853448.330478:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787853448.330517:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787853448.330565:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787853448.330831:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787853448.330846:0:5819:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787853448.330929:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787853448.330938:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787853448.330970:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787853448.331005:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787853448.331428:0:5819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787853448.331473:0:5819:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787853448.331480:0:5819:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787853448.331986:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787853448.332374:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787853448.332401:0:5819:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.110@tcp for mdt 20000000:01000000:0.0:1787853448.332403:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.110@tcp (null) (null) (null) 00000040:00080000:0.0:1787853448.332456:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787853448.332466:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787853448.332500:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787853448.332508:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.110@tcp (null) (null) 00000040:00080000:0.0:1787853448.332554:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787853448.332565:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787853448.333609:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787853448.333653:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787853448.333769:0:5819:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787853448.333773:0:5819:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787853448.333778:0:5819:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787853448.333808:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787853448.333812:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787853448.333843:0:5819:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787853448.333845:0:5819:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787853448.334527:0:5843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787853448.334907:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787853448.334955:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787853448.334990:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1787853448.335016:0:5819:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787853448.335018:0:5819:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787853448.335705:0:5844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787853448.335918:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787853448.335961:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787853448.336027:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1787853448.336042:0:5819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787853448.336045:0:5819:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1787853448.336050:0:5819:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787853448.336052:0:5819:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787853448.336059:0:5819:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787853448.336067:0:5819:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787853448.336816:0:5845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1787853448.337009:0:5819:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787853448.348661:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787853448.348970:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787853448.349092:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787853448.349128:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787853448.349152:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007a602f1f/0xcf1365f7cb054577 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.349172:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007a602f1f/0xcf1365f7cb054577 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.349183:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007a602f1f/0xcf1365f7cb054577 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.349195:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007a602f1f/0xcf1365f7cb054577 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.349202:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007a602f1f/0xcf1365f7cb054577 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.349219:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007a602f1f/0xcf1365f7cb054577 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.349226:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007a602f1f already unused, calling callback (00000000434c13de) 00010000:00010000:0.0:1787853448.349229:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007a602f1f/0xcf1365f7cb054577 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.349237:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007a602f1f/0xcf1365f7cb054577 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.349251:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007a602f1f/0xcf1365f7cb054577 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.349259:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007a602f1f/0xcf1365f7cb054577 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.349264:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007a602f1f/0xcf1365f7cb054577 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787853448.349285:0:5819:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787853448.483481:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005de0c8fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+5:5806:x1874700152078592:12345-0@lo:253: Request processed in 157764us (158179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853448.483503:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787853448.483631:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcb1f6be pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152078592:0@lo:253: 10000000:01000000:2.0:1787853448.483650:0:5806:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787853448.483653:0:5806:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787853448.483655:0:5806:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787853448.483657:0:5806:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787853448.483658:0:5806:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787853448.483667:0:5806:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787853448.483668:0:5806:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787853448.483669:0:5806:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787853448.483701:0:5806:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787853448.483703:0:5806:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787853448.483705:0:5806:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787853448.483706:0:5806:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787853448.483730:0:5806:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003c11661c from lustre-MDT0000 10000000:01000000:2.0:1787853448.483756:0:5806:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787853448.483759:0:5806:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787853448.483763:0:5806:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99274364b3a0 10000000:01000000:2.0:1787853448.483768:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787853448.483776:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99274364b3a0 from 1 10000000:01000000:2.0:1787853448.483779:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787853448.483823:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 0000000005865485/0xcf1365f7cb05457e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853448.483835:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 0000000005865485/0xcf1365f7cb05457e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853448.483843:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 0000000005865485/0xcf1365f7cb05457e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853448.483863:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcb1f6be pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152078720:0@lo:101: 00000100:00100000:2.0:1787853448.483920:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853448.483954:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152078720 00000100:00100000:0.0:1787853448.483963:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152078720 00000100:00100000:2.0:1787853448.483977:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set 00000000388a7595 going to sleep for 11 seconds 00000100:00100000:0.0:1787853448.484006:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787853448.484013:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031fff2a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+5:5806:x1874700152078720:12345-0@lo:101: 00010000:00010000:0.0:1787853448.484028:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853448.484041:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007a602f1f/0xcf1365f7cb054585 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb05457e expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.484067:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007a602f1f/0xcf1365f7cb054585 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb05457e expref: 6 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.484085:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007a602f1f/0xcf1365f7cb054585 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05457e expref: 6 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.484096:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007a602f1f, rc 0) 00000100:00100000:0.0:1787853448.484159:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031fff2a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+6:5806:x1874700152078720:12345-0@lo:101: Request processed in 147us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853448.484166:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787853448.484207:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcb1f6be pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152078720:0@lo:101: 00010000:00010000:2.0:1787853448.484221:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 0000000005865485/0xcf1365f7cb05457e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054585 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853448.484230:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 0000000005865485/0xcf1365f7cb05457e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054585 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853448.484285:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcb1f6be pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152078848:0@lo:501: 00000100:00100000:2.0:1787853448.484309:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853448.484328:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set 00000000388a7595 going to sleep for 11 seconds 00000100:00100000:1.0:1787853448.484543:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152078848 00000100:00100000:1.0:1787853448.484547:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152078848 00000100:00100000:1.0:1787853448.484597:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787853448.484604:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021170aec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+6:5806:x1874700152078848:12345-0@lo:501: 00000100:00100000:1.0:1787853448.484901:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021170aec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+6:5806:x1874700152078848:12345-0@lo:501: Request processed in 297us (592us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787853448.484909:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787853448.484985:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcb1f6be pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152078848:0@lo:501: 10000000:01000000:2.0:1787853448.485008:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787853448.485021:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 0000000005865485/0xcf1365f7cb05457e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054585 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853448.485029:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 0000000005865485/0xcf1365f7cb05457e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054585 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853448.485037:0:5806:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9927436b6000 10000000:01000000:2.0:1787853448.485042:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787853448.485046:0:5806:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9927436b6000 10000000:01000000:2.0:1787853448.485048:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787853448.485050:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9927436b6000 from 1 10000000:01000000:2.0:1787853448.485052:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787853448.485070:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 00000000ce2a60d7/0xcf1365f7cb05458c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853448.485077:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 00000000ce2a60d7/0xcf1365f7cb05458c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853448.485083:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 00000000ce2a60d7/0xcf1365f7cb05458c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853448.485094:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcb1f6be pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152078976:0@lo:101: 00000100:00100000:2.0:1787853448.485142:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853448.485173:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set 00000000388a7595 going to sleep for 11 seconds 00000100:00100000:0.0:1787853448.485184:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152078976 00000100:00100000:0.0:1787853448.485189:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152078976 00000100:00100000:0.0:1787853448.485212:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787853448.485218:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023a572f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+6:5806:x1874700152078976:12345-0@lo:101: 00010000:00010000:0.0:1787853448.485226:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853448.485236:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000048249a6d/0xcf1365f7cb054593 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb05458c expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.485252:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000048249a6d/0xcf1365f7cb054593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb05458c expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.485259:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000048249a6d/0xcf1365f7cb054593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05458c expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.485265:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000048249a6d, rc 0) 00000100:00100000:0.0:1787853448.485302:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023a572f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+7:5806:x1874700152078976:12345-0@lo:101: Request processed in 85us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853448.485308:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787853448.485391:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcb1f6be pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152078976:0@lo:101: 00010000:00010000:2.0:1787853448.485401:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 00000000ce2a60d7/0xcf1365f7cb05458c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054593 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853448.485408:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 00000000ce2a60d7/0xcf1365f7cb05458c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054593 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853448.485418:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787853448.485430:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 00000000ce2a60d7/0xcf1365f7cb05458c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054593 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853448.485435:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 00000000ce2a60d7/0xcf1365f7cb05458c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054593 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853448.485441:0:5806:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787853448.485445:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787853448.485448:0:5806:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9927436b6000 10000000:01000000:2.0:1787853448.485451:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787853448.485453:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787853448.485455:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787853448.485467:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 000000006eb094bc/0xcf1365f7cb05459a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853448.485473:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 000000006eb094bc/0xcf1365f7cb05459a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853448.485479:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 000000006eb094bc/0xcf1365f7cb05459a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853448.485495:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcb1f6be pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152079104:0@lo:101: 00000100:00100000:2.0:1787853448.485519:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853448.485537:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set 00000000388a7595 going to sleep for 11 seconds 00000100:00100000:3.0:1787853448.485607:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152079104 00000100:00100000:3.0:1787853448.485611:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152079104 00000100:00100000:3.0:1787853448.485635:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787853448.485640:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdd7095a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+7:5806:x1874700152079104:12345-0@lo:101: 00010000:00010000:3.0:1787853448.485647:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853448.485656:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000c875335/0xcf1365f7cb0545a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb05459a expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853448.485668:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000c875335/0xcf1365f7cb0545a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb05459a expref: 8 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853448.485691:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000c875335/0xcf1365f7cb0545a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05459a expref: 8 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853448.485697:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000c875335, rc 0) 00000100:00100000:3.0:1787853448.485729:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdd7095a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+8:5806:x1874700152079104:12345-0@lo:101: Request processed in 90us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853448.485735:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787853448.485745:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcb1f6be pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152079104:0@lo:101: 00010000:00010000:2.0:1787853448.485754:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 000000006eb094bc/0xcf1365f7cb05459a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0545a1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853448.485760:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 000000006eb094bc/0xcf1365f7cb05459a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0545a1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853448.485795:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcb1f6be pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152079232:0@lo:501: 00000100:00100000:2.0:1787853448.485818:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853448.485881:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set 00000000388a7595 going to sleep for 11 seconds 00000100:00100000:0.0:1787853448.485915:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152079232 00000100:00100000:0.0:1787853448.485919:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152079232 00000100:00100000:0.0:1787853448.485969:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787853448.485978:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd8d07eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+8:5806:x1874700152079232:12345-0@lo:501: 00000100:00100000:0.0:1787853448.486163:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd8d07eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+9:5806:x1874700152079232:12345-0@lo:501: Request processed in 184us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853448.486169:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787853448.486177:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcb1f6be pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152079232:0@lo:501: 00000100:00100000:2.0:1787853448.486202:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcb1f6be pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152079360:0@lo:503: 00000100:00100000:2.0:1787853448.486238:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853448.486289:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set 00000000388a7595 going to sleep for 11 seconds 00000100:00100000:3.0:1787853448.486342:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152079360 00000100:00100000:3.0:1787853448.486430:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152079360 00000100:00100000:3.0:1787853448.486461:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787853448.486466:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e1b02a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+9:5806:x1874700152079360:12345-0@lo:503: 00000100:00100000:3.0:1787853448.486613:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e1b02a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+9:5806:x1874700152079360:12345-0@lo:503: Request processed in 148us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853448.486620:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787853448.486725:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcb1f6be pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152079360:0@lo:503: 00000100:00100000:2.0:1787853448.487143:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcb1f6be pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5847:1874700152079488:0@lo:502: 00000100:00100000:2.0:1787853448.487179:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853448.487234:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c1adec49 going to sleep for 11 seconds 00000100:00100000:0.0:1787853448.487318:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152079488 00000100:00100000:0.0:1787853448.487323:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152079488 00000100:00100000:0.0:1787853448.487355:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787853448.487362:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd7d3efd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+9:5847:x1874700152079488:12345-0@lo:502: 00000100:00100000:0.0:1787853448.487553:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd7d3efd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+9:5847:x1874700152079488:12345-0@lo:502: Request processed in 192us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853448.487560:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787853448.487619:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcb1f6be pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5847:1874700152079488:0@lo:502: 00000020:01000000:2.0:1787853448.487643:0:5847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787853448.487654:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853448.487657:0:5847:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787853448.487662:0:5847:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787853448.487668:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787853448.487748:0:5847:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000778a0272) 00000020:00000080:2.0:1787853448.487766:0:5847:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787853448.487772:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787853448.487846:0:5847:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787853448.487854:0:5847:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf1365f7cb0545af 00000020:00000080:2.0:1787853448.488079:0:5847:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787853448.488083:0:5847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853448.488085:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853448.488087:0:5847:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787853448.488089:0:5847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787853448.488092:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853448.488093:0:5847:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787853448.488096:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787853448.488148:0:5847:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000006e08c1db) 00000020:00000080:2.0:1787853448.488160:0:5847:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787853448.488165:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787853448.488167:0:5847:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787853448.488170:0:5847:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787853448.488176:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787853448.488216:0:5847:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003c11661c from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787853448.488229:0:5847:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000010921de3) 00000020:00000080:2.0:1787853448.488326:0:5847:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787853448.488382:0:5847:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787853448.488387:0:5847:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf1365f7cb0545c4 00000020:00000080:2.0:1787853448.488491:0:5847:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787853448.488497:0:5847:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787853448.488502:0:5847:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcf1365f7cb0545cb 00080000:01000000:2.0:1787853448.488507:0:5847:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787853448.488510:0:5847:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf1365f7cb0545d2 00080000:10000000:2.0:1787853448.489010:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1787853448.489191:0:5847:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787853448.492380:0:5847:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787853448.543296:0:5847:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787853448.543908:0:5847:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787853448.546750:0:5847:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787853448.547120:0:5847:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787853448.578207:0:5847:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000cc59bc50) 00000020:00000080:1.0:1787853448.578244:0:5847:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787853448.578394:0:5847:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787853448.578405:0:5847:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf1365f7cb0545e0 00000020:00000080:0.0:1787853448.580350:0:5847:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1787853448.587313:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787853448.640369:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787853448.684720:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787853448.722269:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787853448.799241:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787853448.854202:0:5847:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1787853448.886439:0:5847:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcf1365f7cb0545e7 00000020:00000080:2.0:1787853448.886845:0:5847:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787853448.886859:0:5847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853448.886867:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853448.886869:0:5847:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787853448.886873:0:5847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787853448.886877:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853448.886878:0:5847:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787853448.886881:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787853448.886883:0:5847:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787853448.886886:0:5847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853448.886888:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853448.886889:0:5847:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787853448.886891:0:5847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787853448.886896:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853448.886897:0:5847:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787853448.886901:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787853448.886940:0:5847:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1787853448.887003:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcb1f6be pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5847:1874700152079616:0@lo:502: 00000100:00100000:2.0:1787853448.887174:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853448.887321:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032390e96 going to sleep for 11 seconds 00000100:00100000:0.0:1787853448.887487:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152079616 00000100:00100000:0.0:1787853448.887495:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152079616 00000100:00100000:0.0:1787853448.887580:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787853448.887590:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007568b29d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+9:5847:x1874700152079616:12345-0@lo:502: 00000100:00100000:0.0:1787853448.888022:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007568b29d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+9:5847:x1874700152079616:12345-0@lo:502: Request processed in 432us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853448.888030:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787853448.888137:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcb1f6be pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5847:1874700152079616:0@lo:502: 00000020:01000000:2.0:1787853448.888166:0:5847:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853448.888172:0:5847:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853448.888174:0:5847:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1787853448.888178:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787853448.888409:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787853448.888427:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787853448.888447:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 000000006eb094bc/0xcf1365f7cb05459a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0545a1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.888476:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 000000006eb094bc/0xcf1365f7cb05459a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0545a1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853448.888485:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9927436b6000 from 1 10000000:01000000:1.0:1787853448.888488:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787853448.888521:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 000000009ff31e5f/0xcf1365f7cb0545ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.888528:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 000000009ff31e5f/0xcf1365f7cb0545ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.888537:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 000000009ff31e5f/0xcf1365f7cb0545ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853448.888554:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff4ad30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152079744:0@lo:101: 00000100:00100000:1.0:1787853448.888587:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853448.889162:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set 0000000093419cb8 going to sleep for 11 seconds 00000100:00100000:0.0:1787853448.889297:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152079744 00000100:00100000:0.0:1787853448.889304:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152079744 00000100:00100000:0.0:1787853448.889335:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787853448.889341:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010d1219f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+9:5806:x1874700152079744:12345-0@lo:101: 00010000:00010000:0.0:1787853448.889365:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853448.889379:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c4857b80/0xcf1365f7cb0545f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0545ee expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.889402:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c4857b80/0xcf1365f7cb0545f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0545ee expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.889411:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c4857b80/0xcf1365f7cb0545f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0545ee expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.889419:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c4857b80, rc 0) 00000100:00100000:0.0:1787853448.889468:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010d1219f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+10:5806:x1874700152079744:12345-0@lo:101: Request processed in 127us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853448.889474:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787853448.889567:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff4ad30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152079744:0@lo:101: 00010000:00010000:1.0:1787853448.889581:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 000000009ff31e5f/0xcf1365f7cb0545ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0545f5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.889589:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 000000009ff31e5f/0xcf1365f7cb0545ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0545f5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853448.890203:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff4ad30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152079872:0@lo:256: 00000100:00100000:1.0:1787853448.890504:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853448.890529:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set 0000000093419cb8 going to sleep for 11 seconds 00000100:00100000:0.0:1787853448.890617:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152079872 00000100:00100000:0.0:1787853448.890623:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152079872 00000100:00100000:0.0:1787853448.890651:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787853448.890657:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072764b6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+10:5806:x1874700152079872:12345-0@lo:256: 20000000:01000000:0.0:1787853448.890712:0:5818:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787853448.890719:0:5818:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787853448.890786:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072764b6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+10:5806:x1874700152079872:12345-0@lo:256: Request processed in 129us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853448.890793:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787853448.890874:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff4ad30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152079872:0@lo:256: 10000000:01000000:1.0:1787853448.891578:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787853448.891609:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 000000009ff31e5f/0xcf1365f7cb0545ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0545f5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.891620:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 000000009ff31e5f/0xcf1365f7cb0545ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0545f5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853448.891628:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9927436b6000 from 1 10000000:01000000:1.0:1787853448.891631:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787853448.891662:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 0000000086efd64e/0xcf1365f7cb0545fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.891669:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 0000000086efd64e/0xcf1365f7cb0545fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.891709:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 0000000086efd64e/0xcf1365f7cb0545fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853448.891728:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff4ad30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152080000:0@lo:101: 00000100:00100000:1.0:1787853448.891766:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853448.891791:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set 0000000093419cb8 going to sleep for 11 seconds 00000100:00100000:0.0:1787853448.891933:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152080000 00000100:00100000:0.0:1787853448.891939:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152080000 00000100:00100000:0.0:1787853448.891966:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787853448.891972:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7859ba9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+10:5806:x1874700152080000:12345-0@lo:101: 00010000:00010000:0.0:1787853448.891985:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853448.892006:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008566c0ab/0xcf1365f7cb054603 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0545fc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.892027:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008566c0ab/0xcf1365f7cb054603 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0545fc expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.892036:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008566c0ab/0xcf1365f7cb054603 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0545fc expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.892044:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008566c0ab, rc 0) 00000100:00100000:0.0:1787853448.892086:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7859ba9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:5806:x1874700152080000:12345-0@lo:101: Request processed in 114us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853448.892092:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787853448.892343:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff4ad30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152080000:0@lo:101: 00010000:00010000:1.0:1787853448.892355:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 0000000086efd64e/0xcf1365f7cb0545fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054603 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.892363:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 0000000086efd64e/0xcf1365f7cb0545fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054603 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853448.892423:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff4ad30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152080128:0@lo:501: 00000100:00100000:1.0:1787853448.892446:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853448.892467:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set 0000000093419cb8 going to sleep for 11 seconds 00000100:00100000:0.0:1787853448.892514:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152080128 00000100:00100000:0.0:1787853448.892518:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152080128 00000100:00100000:0.0:1787853448.892545:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787853448.892550:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ba82559 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:5806:x1874700152080128:12345-0@lo:501: 00000100:00100000:0.0:1787853448.893299:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ba82559 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:5806:x1874700152080128:12345-0@lo:501: Request processed in 747us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853448.893308:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787853448.893430:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff4ad30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152080128:0@lo:501: 00000100:00100000:1.0:1787853448.893469:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff4ad30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152080256:0@lo:503: 00000100:00100000:1.0:1787853448.893512:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853448.893576:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set 0000000093419cb8 going to sleep for 11 seconds 00000100:00100000:3.0:1787853448.893650:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152080256 00000100:00100000:3.0:1787853448.893656:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152080256 00000100:00100000:2.0:1787853448.893861:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787853448.893870:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fa9a4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:5806:x1874700152080256:12345-0@lo:503: 00000040:00080000:2.0:1787853448.893914:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787853448.894004:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fa9a4a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:5806:x1874700152080256:12345-0@lo:503: Request processed in 136us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853448.894019:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787853448.894203:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff4ad30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152080256:0@lo:503: 00000040:00080000:3.0:1787853448.895377:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1787853448.895586:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787853448.895605:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787853448.895659:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 0000000086efd64e/0xcf1365f7cb0545fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054603 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.895698:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 0000000086efd64e/0xcf1365f7cb0545fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054603 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853448.895743:0:5806:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787853448.895746:0:5806:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9927436b6000 10000000:01000000:1.0:1787853448.895748:0:5806:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9927436b6000 10000000:01000000:1.0:1787853448.895752:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787853448.895757:0:5806:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9927436b6000 from 1 10000000:01000000:1.0:1787853448.895760:0:5806:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787853448.895793:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 000000002328bac7/0xcf1365f7cb05460a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.895801:0:5806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 000000002328bac7/0xcf1365f7cb05460a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.895825:0:5806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 000000002328bac7/0xcf1365f7cb05460a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853448.895846:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff4ad30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152080384:0@lo:101: 00000100:00100000:1.0:1787853448.895905:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853448.895944:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dc152506 going to sleep for 11 seconds 00000100:00100000:2.0:1787853448.896023:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152080384 00000100:00100000:2.0:1787853448.896032:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152080384 00000100:00100000:2.0:1787853448.896070:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787853448.896078:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e19c73f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:5806:x1874700152080384:12345-0@lo:101: 00010000:00010000:2.0:1787853448.896092:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853448.896120:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000580c1a19/0xcf1365f7cb054611 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb05460a expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853448.896146:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000580c1a19/0xcf1365f7cb054611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb05460a expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853448.896156:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000580c1a19/0xcf1365f7cb054611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05460a expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853448.896165:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000580c1a19, rc 0) 00000100:00100000:2.0:1787853448.896202:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e19c73f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:5806:x1874700152080384:12345-0@lo:101: Request processed in 125us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853448.896209:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787853448.896391:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff4ad30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152080384:0@lo:101: 00010000:00010000:1.0:1787853448.896406:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 000000002328bac7/0xcf1365f7cb05460a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054611 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.896413:0:5806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 000000002328bac7/0xcf1365f7cb05460a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054611 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853448.896461:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff4ad30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152080512:0@lo:501: 00000100:00100000:1.0:1787853448.896485:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853448.896513:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dc152506 going to sleep for 11 seconds 00000100:00100000:2.0:1787853448.896557:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152080512 00000100:00100000:2.0:1787853448.896562:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152080512 00000100:00100000:2.0:1787853448.896589:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787853448.896595:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae4ce2e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:5806:x1874700152080512:12345-0@lo:501: 00000100:00100000:2.0:1787853448.897053:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae4ce2e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:5806:x1874700152080512:12345-0@lo:501: Request processed in 457us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853448.897061:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787853448.897305:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff4ad30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152080512:0@lo:501: 00000100:00100000:1.0:1787853448.897336:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff4ad30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152080640:0@lo:503: 00000100:00100000:1.0:1787853448.897378:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853448.897440:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dc152506 going to sleep for 11 seconds 00000100:00100000:3.0:1787853448.897477:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152080640 00000100:00100000:3.0:1787853448.897483:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152080640 00000100:00100000:3.0:1787853448.897548:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787853448.897555:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a02800b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:5806:x1874700152080640:12345-0@lo:503: 00000100:00100000:3.0:1787853448.897896:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a02800b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:5806:x1874700152080640:12345-0@lo:503: Request processed in 342us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853448.897903:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787853448.897979:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff4ad30f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152080640:0@lo:503: 00000100:00100000:0.0:1787853448.898378:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd6039c7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5853:1874700152080768:0@lo:502: 00000100:00100000:0.0:1787853448.898420:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853448.898586:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032538cd1 going to sleep for 11 seconds 00000100:00100000:1.0:1787853448.898631:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152080768 00000100:00100000:1.0:1787853448.898636:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152080768 00000100:00100000:1.0:1787853448.898659:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787853448.898664:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f33511be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:5853:x1874700152080768:12345-0@lo:502: 00000100:00100000:1.0:1787853448.898884:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f33511be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:5853:x1874700152080768:12345-0@lo:502: Request processed in 219us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853448.898896:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787853448.899023:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd6039c7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5853:1874700152080768:0@lo:502: 00000020:01000004:0.0:1787853448.899089:0:5853:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787853448.899131:0:5853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000ad731325) 00000020:00000080:0.0:1787853448.899153:0:5853:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787853448.899237:0:5853:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003c11661c from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787853448.899241:0:5853:0:(tgt_mount.c:187:server_put_mount()) put mount 000000003c11661c from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787853448.899243:0:5853:0:(obd_mount.c:710:lustre_put_lsi()) put 000000003c11661c 4 00010000:00080000:0.0:1787853448.899273:0:5853:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b42cfa51@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.110@tcp at head 00010000:00010000:0.0:1787853448.900950:0:5853:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787853448.901170:0:5853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787853448.901203:0:5853:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787853448.901226:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcf1365f7cb05461f 00000100:00080000:0.0:1787853448.901237:0:5853:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787853448.901241:0:5853:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b42cfa51 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:0.0:1787853448.901278:0:5853:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fd6039c7 x1874700152080896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787853448.901312:0:5853:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787853448.904134:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd6039c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874700152080896:0@lo:38: 00000100:00100000:3.0:1787853448.904225:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853448.904319:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152080896 00000100:00100000:3.0:1787853448.904328:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152080896 00000100:00100000:3.0:1787853448.904365:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853448.904372:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000893ee118 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3296:x1874700152080896:12345-0@lo:38: 00000100:00100000:3.0:1787853448.904433:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000893ee118 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3296:x1874700152080896:12345-0@lo:38: Request processed in 62us (208us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787853448.904440:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853448.904476:0:3296:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787853448.904484:0:3296:0:(import.c:65:import_set_state_nolock()) 00000000b42cfa51 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787853448.904488:0:3296:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787853448.904491:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd6039c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874700152080896:0@lo:38: 00000100:00100000:0.0:1787853448.907741:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000088b26f8f pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5853:1874700152081024:0@lo:502: 00000100:00100000:0.0:1787853448.907847:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853448.907893:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069c4622e going to sleep for 11 seconds 00000100:00100000:2.0:1787853448.907969:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152081024 00000100:00100000:2.0:1787853448.907979:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152081024 00000100:00100000:2.0:1787853448.908038:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787853448.908047:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8d30c95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:5853:x1874700152081024:12345-0@lo:502: 00000100:00100000:2.0:1787853448.908383:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8d30c95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:5853:x1874700152081024:12345-0@lo:502: Request processed in 337us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853448.908392:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787853448.908499:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000088b26f8f pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5853:1874700152081024:0@lo:502: 00000040:00080000:0.0:1787853448.908531:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787853448.912273:0:5806:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787853448.912380:0:5806:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787853448.912427:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 000000002328bac7/0xcf1365f7cb05460a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054611 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853448.912441:0:5806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 000000002328bac7/0xcf1365f7cb05460a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054611 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787853448.912511:0:5806:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787853448.912514:0:5806:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787853448.912515:0:5806:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787853448.912516:0:5806:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787853448.912517:0:5806:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787853448.912519:0:5806:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787853448.912520:0:5806:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787853448.912521:0:5806:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787853448.912523:0:5806:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787853448.912524:0:5806:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787853448.912526:0:5806:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787853448.912527:0:5806:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787853448.912531:0:5806:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787853448.912534:0:5806:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787853448.912535:0:5806:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787853448.912537:0:5806:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787853448.912538:0:5806:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787853448.912539:0:5806:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787853448.912540:0:5806:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787853448.912541:0:5806:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787853448.912542:0:5806:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787853448.912543:0:5806:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787853448.912549:0:5806:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787853448.912549:0:5806:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787853448.912550:0:5806:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787853448.912578:0:5806:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787853448.912597:0:5806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcb1f6be pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152081152:0@lo:253: 00000100:00100000:2.0:1787853448.912695:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853448.912736:0:5806:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a1b61b42 going to sleep for 11 seconds 00000100:00100000:3.0:1787853448.913240:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152081152 00000100:00100000:3.0:1787853448.913248:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152081152 00000100:00100000:2.0:1787853448.913365:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787853448.913375:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a32a379 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:5806:x1874700152081152:12345-0@lo:253: 20000000:01000000:2.0:1787853448.913402:0:5819:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787853448.913415:0:5819:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787853448.947160:0:5819:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787853448.947216:0:5819:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787853448.950489:0:5840:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787853448.950502:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787853448.950526:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000072ab78fc/0xcf1365f7cb054626 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853448.950547:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c4857b80/0xcf1365f7cb0545f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0545ee expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853448.950556:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000072ab78fc/0xcf1365f7cb054626 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853448.950601:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c4857b80/0xcf1365f7cb0545f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb0545ee expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853448.950620:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c4857b80/0xcf1365f7cb0545f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb0545ee expref: 12 pid: 5818 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853448.950634:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c05b6ddc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5840:1874700152081280:0@lo:104: 00000100:00100000:2.0:1787853448.950733:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853448.950787:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 000000002cbe4ca8 going to sleep for 11 seconds 00000100:00100000:0.0:1787853448.950877:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152081280 00000100:00100000:0.0:1787853448.950886:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152081280 00000100:00100000:0.0:1787853448.950942:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787853448.950950:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000300fae70 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:5840:x1874700152081280:12345-0@lo:104: 00010000:00010000:0.0:1787853448.950963:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: 000000009ff31e5f/0xcf1365f7cb0545ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0545f5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853448.951022:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787853448.951032:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000300fae70 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:5840:x1874700152081280:12345-0@lo:104: Request processed in 84us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853448.951039:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787853448.951143:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c05b6ddc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5840:1874700152081280:0@lo:104: 00010000:00010000:2.0:1787853448.951165:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000072ab78fc/0xcf1365f7cb054626 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853448.951274:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853448.951280:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: 000000009ff31e5f/0xcf1365f7cb0545ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0545f5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853448.951288:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009ff31e5f already unused, calling callback (0000000022b51fdf) 10000000:00010000:3.0:1787853448.951369:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: 000000009ff31e5f/0xcf1365f7cb0545ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb0545f5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853448.951377:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: 000000009ff31e5f/0xcf1365f7cb0545ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb0545f5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853448.951383:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: 000000009ff31e5f/0xcf1365f7cb0545ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb0545f5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853448.951389:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787853448.951465:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: 000000009ff31e5f/0xcf1365f7cb0545ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0545f5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853448.951472:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787853448.951500:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: 000000009ff31e5f/0xcf1365f7cb0545ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0545f5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853448.951507:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: 000000009ff31e5f/0xcf1365f7cb0545ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0545f5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853448.951529:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853448.951531:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853448.951532:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853448.951585:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853448.951605:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000043348a9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152081408:0@lo:103: 00000100:00100000:3.0:1787853448.951637:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853448.952448:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152081408 00000100:00100000:1.0:1787853448.952457:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152081408 00010000:00010000:1.0:1787853448.952487:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c4857b80/0xcf1365f7cb0545f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0545ee expref: 13 pid: 5818 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853448.952532:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787853448.952540:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c67e9a18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:3297:x1874700152081408:12345-0@lo:103: 00010000:00010000:1.0:1787853448.952553:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853448.952557:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c4857b80/0xcf1365f7cb0545f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0545ee expref: 13 pid: 5818 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.952567:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c4857b80/0xcf1365f7cb0545f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb0545ee expref: 13 pid: 5818 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.952580:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c4857b80/0xcf1365f7cb0545f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb0545ee expref: 13 pid: 5818 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.952598:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000072ab78fc/0xcf1365f7cb054626 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.952605:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000072ab78fc/0xcf1365f7cb054626 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787853448.952619:0:5809:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002119374s 00010000:00010000:1.0:1787853448.952623:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000072ab78fc/0xcf1365f7cb054626 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.952629:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000072ab78fc/0xcf1365f7cb054626 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.952648:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000072ab78fc/0xcf1365f7cb054626 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.952653:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000072ab78fc/0xcf1365f7cb054626 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.952658:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000072ab78fc already unused, calling callback (00000000434c13de) 00010000:00010000:1.0:1787853448.952662:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000072ab78fc/0xcf1365f7cb054626 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.952668:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000072ab78fc/0xcf1365f7cb054626 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.952710:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000072ab78fc/0xcf1365f7cb054626 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853448.952721:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853448.952769:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c67e9a18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:3297:x1874700152081408:12345-0@lo:103: Request processed in 229us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853448.952776:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853448.953768:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000043348a9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152081408:0@lo:103: 00010000:00010000:3.0:1787853448.953804:0:5840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000072ab78fc/0xcf1365f7cb054626 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853448.953814:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000072ab78fc/0xcf1365f7cb054626 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853448.953819:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000072ab78fc/0xcf1365f7cb054626 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853448.966866:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a32a379 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:5806:x1874700152081152:12345-0@lo:253: Request processed in 53480us (54182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853448.966885:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787853448.967013:0:5806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcb1f6be pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5806:1874700152081152:0@lo:253: 10000000:01000000:0.0:1787853448.967034:0:5806:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787853448.967038:0:5806:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787853448.967040:0:5806:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787853448.967041:0:5806:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787853448.967043:0:5806:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787853448.967044:0:5806:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787853448.967045:0:5806:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787853448.967046:0:5806:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787853448.967048:0:5806:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787853448.967049:0:5806:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787853448.967051:0:5806:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787853448.967052:0:5806:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787853448.967053:0:5806:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787853448.967075:0:5806:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787853448.982464:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787853448.984315:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787853448.985026:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787853448.985275:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787853448.985473:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787853448.985650:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787853448.989945:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787853448.990938:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787853448.992051:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787853448.992329:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787853448.992525:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787853448.992973:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1787853449.077462:0:5806:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:1.0:1787853449.097915:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787853449.110201:0:5806:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1787853449.110753:0:5859:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1787853449.111565:0:5858:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787853449.111570:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787853449.119772:0:5806:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787853449.120126:0:5806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787853449.120588:0:5806:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787853449.120596:0:5806:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787853449.120896:0:5806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787853449.121942:0:5806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787853449.122467:0:5806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787853449.122556:0:5806:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787853449.122820:0:5806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787853449.123002:0:5806:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1787853449.131286:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787853449.131438:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787853449.131555:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787853449.131717:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787853449.131839:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787853449.131994:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787853449.132138:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787853449.132266:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787853449.132393:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787853449.132530:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787853449.132647:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787853449.135783:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787853449.135956:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787853449.136127:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787853449.136269:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787853449.136468:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787853449.136832:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787853449.137002:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787853449.137148:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787853449.137294:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787853449.137421:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787853449.137555:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787853449.137740:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787853449.137871:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787853449.137985:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787853449.138137:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787853449.141847:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787853449.142172:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787853449.142293:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787853449.142423:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787853449.143452:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787853449.143968:0:5806:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787853449.144199:0:5806:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1787853449.169859:0:5859:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1787853449.247804:0:5806:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787853449.247852:0:5806:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffad8d829cf988 00100000:10000000:3.0:1787853449.247862:0:5806:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000040:00080000:2.0:1787853449.250053:0:5859:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787853449.250162:0:5859:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787853449.250167:0:5859:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:01000004:3.0:1787853449.251889:0:5806:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787853449.251909:0:5806:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.110@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787853449.251925:0:5806:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787853449.251944:0:5806:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1787853450.118355:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853451.144772:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853452.167206:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853453.191368:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787853453.223387:0:6101:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1787853454.150325:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787853454.150342:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787853454.150352:0:37:0:(import.c:65:import_set_state_nolock()) 00000000b42cfa51 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787853454.150368:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b42cfa51 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:1.0:1787853454.150395:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004d118669 x1874700152081664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787853454.150437:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004d118669 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874700152081664:0@lo:38: 00000100:00100000:1.0:1787853454.150526:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853454.150612:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152081664 00000100:00100000:0.0:1787853454.150851:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853454.150861:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2b2769a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152081536:0@lo:400: 00000100:00100000:0.0:1787853454.150900:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853454.151020:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152081664 00000100:00100000:1.0:1787853454.151111:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787853454.151119:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044d14af9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3296:x1874700152081664:12345-0@lo:38: 00010000:00080000:1.0:1787853454.151148:0:5826:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:1.0:1787853454.151187:0:5826:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcf1365f7cb05462d 00000004:00100000:1.0:1787853454.151237:0:5826:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787853454.151357:0:5826:0:(import.c:65:import_set_state_nolock()) 00000000080e6589 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787853454.151416:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044d14af9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874700152081664:12345-0@lo:38: Request processed in 297us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853454.151424:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787853454.151509:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004d118669 x1874700152081664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787853464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787853454.151548:0:3296:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787853454.151556:0:3296:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787853454.151561:0:3296:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787853454.151562:0:3296:0:(import.c:65:import_set_state_nolock()) 00000000b42cfa51 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787853454.151574:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004d118669 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874700152081664:0@lo:38: 00000100:00100000:3.0:1787853454.151951:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152081536 00000100:00100000:3.0:1787853454.151957:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152081536 00000100:00100000:3.0:1787853454.152034:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787853454.152042:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd7d83da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:3300:x1874700152081536:12345-0@lo:400: 00000100:00100000:3.0:1787853454.152101:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd7d83da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:3300:x1874700152081536:12345-0@lo:400: Request processed in 60us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853454.152118:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787853454.152212:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2b2769a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152081536:0@lo:400: 00010000:00010000:0.0:1787853454.214991:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853455.242430:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853456.261807:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787853456.709755:0:5821:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787853456.709765:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9927436b6000 from 3 10000000:01000000:0.0:1787853456.709771:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787853456.709835:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 00000000286231e9/0xcf1365f7cb054634 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853456.709854:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 00000000286231e9/0xcf1365f7cb054634 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853456.709866:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 00000000286231e9/0xcf1365f7cb054634 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853456.709899:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000021244ee6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152081792:0@lo:101: 00000100:00100000:0.0:1787853456.709999:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853456.710071:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152081792 00000100:00100000:2.0:1787853456.710080:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152081792 00000100:00100000:0.0:1787853456.710083:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set 000000006cee6ed2 going to sleep for 11 seconds 00000100:00100000:2.0:1787853456.710136:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787853456.710147:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0e4074d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:5821:x1874700152081792:12345-0@lo:101: 00010000:00010000:2.0:1787853456.710166:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853456.710179:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000edee793e/0xcf1365f7cb05463b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb054634 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853456.710205:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000edee793e/0xcf1365f7cb05463b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb054634 expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853456.710218:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000edee793e/0xcf1365f7cb05463b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054634 expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853456.710233:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000edee793e, rc 0) 00000100:00100000:2.0:1787853456.710297:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0e4074d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:5821:x1874700152081792:12345-0@lo:101: Request processed in 152us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853456.710304:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787853456.710723:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000021244ee6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152081792:0@lo:101: 00010000:00010000:0.0:1787853456.710740:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 00000000286231e9/0xcf1365f7cb054634 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05463b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853456.710749:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 00000000286231e9/0xcf1365f7cb054634 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb05463b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853456.710813:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000021244ee6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152081920:0@lo:256: 00000100:00100000:0.0:1787853456.710849:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853456.710936:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set 000000006cee6ed2 going to sleep for 11 seconds 00000100:00100000:3.0:1787853456.711122:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152081920 00000100:00100000:3.0:1787853456.711128:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152081920 00000100:00100000:3.0:1787853456.711194:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787853456.711202:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e5765b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:5821:x1874700152081920:12345-0@lo:256: 20000000:01000000:3.0:1787853456.711221:0:5816:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787853456.711241:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787853456.711244:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787853456.711358:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e5765b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:5821:x1874700152081920:12345-0@lo:256: Request processed in 156us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853456.711365:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787853456.711440:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000021244ee6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152081920:0@lo:256: 10000000:01000000:2.0:1787853456.711484:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787853456.711491:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: 00000000286231e9/0xcf1365f7cb054634 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05463b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853456.711504:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: 00000000286231e9/0xcf1365f7cb054634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05463b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853457.285966:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787853458.023339:0:6303:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd01b8d7d0 20000000:00000080:0.0:1787853458.024221:0:6303:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99277bc02c00 uarg=0000000000000000 20000000:01000000:0.0:1787853458.024269:0:6303:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787853458.024276:0:6303:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787853458.024283:0:6303:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787853458.024956:0:6303:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1787853458.024970:0:6303:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787853458.030290:0:6303:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787853458.031030:0:6303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787853458.031114:0:6303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787853458.031166:0:6303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787853458.031185:0:6303:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787853458.031208:0:6303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c4857b80/0xcf1365f7cb054642 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853458.031231:0:6303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008566c0ab/0xcf1365f7cb054603 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0545fc expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853458.031239:0:6303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c4857b80/0xcf1365f7cb054642 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853458.031287:0:6303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008566c0ab/0xcf1365f7cb054603 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb0545fc expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853458.031304:0:6303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008566c0ab/0xcf1365f7cb054603 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb0545fc expref: 11 pid: 5818 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853458.031334:0:6303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008f2aceed pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6303:1874700152082048:0@lo:104: 00000100:00100000:0.0:1787853458.031414:0:6303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853458.031490:0:6303:0:(client.c:2715:ptlrpc_set_wait()) set 000000000ebfba70 going to sleep for 11 seconds 00000100:00100000:2.0:1787853458.031625:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152082048 00000100:00100000:2.0:1787853458.031634:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152082048 00000100:00100000:2.0:1787853458.031727:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787853458.031737:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aab1f4cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:6303:x1874700152082048:12345-0@lo:104: 00010000:00010000:2.0:1787853458.031751:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: 0000000086efd64e/0xcf1365f7cb0545fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054603 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853458.031820:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787853458.031826:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aab1f4cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:6303:x1874700152082048:12345-0@lo:104: Request processed in 92us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853458.031833:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787853458.031857:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853458.031863:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: 0000000086efd64e/0xcf1365f7cb0545fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054603 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853458.031871:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000086efd64e already unused, calling callback (0000000022b51fdf) 10000000:00010000:2.0:1787853458.031874:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: 0000000086efd64e/0xcf1365f7cb0545fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb054603 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853458.031882:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: 0000000086efd64e/0xcf1365f7cb0545fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb054603 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853458.031889:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: 0000000086efd64e/0xcf1365f7cb0545fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb054603 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853458.031911:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787853458.031947:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: 0000000086efd64e/0xcf1365f7cb0545fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054603 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853458.031953:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853458.031972:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: 0000000086efd64e/0xcf1365f7cb0545fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054603 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853458.031978:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: 0000000086efd64e/0xcf1365f7cb0545fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054603 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853458.031997:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853458.031999:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853458.032000:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853458.032016:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787853458.032029:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003fd06f8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152082176:0@lo:103: 00000100:00100000:2.0:1787853458.032090:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853458.032138:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152082176 00000100:00100000:2.0:1787853458.032143:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152082176 00010000:00010000:2.0:1787853458.032160:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008566c0ab/0xcf1365f7cb054603 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0545fc expref: 12 pid: 5818 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853458.032182:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787853458.032188:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025f985bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:3299:x1874700152082176:12345-0@lo:103: 00010000:00010000:2.0:1787853458.032198:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853458.032202:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008566c0ab/0xcf1365f7cb054603 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0545fc expref: 12 pid: 5818 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853458.032211:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008566c0ab/0xcf1365f7cb054603 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb0545fc expref: 12 pid: 5818 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853458.032236:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c4857b80/0xcf1365f7cb054642 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853458.032243:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c4857b80/0xcf1365f7cb054642 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853458.032256:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c4857b80/0xcf1365f7cb054642 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853458.032262:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c4857b80/0xcf1365f7cb054642 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853458.032267:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c4857b80/0xcf1365f7cb054642 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853458.032273:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c4857b80/0xcf1365f7cb054642 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853458.032278:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c4857b80 already unused, calling callback (00000000434c13de) 00010000:00010000:2.0:1787853458.032282:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c4857b80/0xcf1365f7cb054642 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853458.032288:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c4857b80/0xcf1365f7cb054642 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853458.032295:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c4857b80/0xcf1365f7cb054642 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853458.032304:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853458.032337:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025f985bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:3299:x1874700152082176:12345-0@lo:103: Request processed in 149us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853458.032352:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787853458.032392:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003fd06f8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152082176:0@lo:103: 00010000:00010000:3.0:1787853458.032585:0:6303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008566c0ab/0xcf1365f7cb054603 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb0545fc expref: 11 pid: 5818 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853458.032597:0:6303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008f2aceed pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6303:1874700152082048:0@lo:104: 00010000:00010000:3.0:1787853458.032616:0:6303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c4857b80/0xcf1365f7cb054642 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853458.032624:0:6303:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c4857b80/0xcf1365f7cb054642 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853458.032629:0:6303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c4857b80/0xcf1365f7cb054642 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853458.032634:0:6303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c4857b80/0xcf1365f7cb054642 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853458.310832:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853459.270574:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059282bf5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152082304:0@lo:400: 00000100:00100000:0.0:1787853459.270704:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853459.270923:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051a215ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152082432:0@lo:400: 00000100:00100000:1.0:1787853459.270961:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853459.272408:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152082304 00000100:00100000:0.0:1787853459.272424:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152082304 00000100:00100000:0.0:1787853459.272497:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787853459.272508:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc94da0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:3297:x1874700152082304:12345-0@lo:400: 00000100:00100000:0.0:1787853459.272604:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc94da0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:3297:x1874700152082304:12345-0@lo:400: Request processed in 99us (1901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853459.272613:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787853459.272660:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152082432 00000100:00100000:0.0:1787853459.272666:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152082432 00000100:00100000:0.0:1787853459.272721:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787853459.272727:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca03a86f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152082432:12345-0@lo:400: 00000100:00100000:0.0:1787853459.272772:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca03a86f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152082432:12345-0@lo:400: Request processed in 46us (1812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853459.272779:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787853459.272808:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000051a215ac x1874700152082432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853459.272818:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059282bf5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152082304:0@lo:400: 00000100:00100000:3.0:1787853459.272835:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051a215ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152082432:0@lo:400: 00010000:00010000:2.0:1787853459.335501:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853460.358108:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853461.398391:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853462.411765:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853463.429844:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853464.394327:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007779d376 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152082560:0@lo:400: 00000100:00100000:2.0:1787853464.394400:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853464.394461:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787853464.394472:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7fcbcc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152082688:0@lo:400: 00000100:00100000:2.0:1787853464.394616:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853464.395051:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152082560 00000100:00100000:3.0:1787853464.395060:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152082560 00000100:00100000:3.0:1787853464.395109:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787853464.395116:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fca5a040 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:3299:x1874700152082560:12345-0@lo:400: 00000100:00100000:3.0:1787853464.395173:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fca5a040 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:3299:x1874700152082560:12345-0@lo:400: Request processed in 57us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853464.395180:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787853464.395226:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007779d376 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152082560:0@lo:400: 00000100:00100000:1.0:1787853464.395295:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152082688 00000100:00100000:1.0:1787853464.395301:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152082688 00000100:00100000:1.0:1787853464.395344:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787853464.395461:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fd06f8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152082688:12345-0@lo:400: 00000100:00100000:1.0:1787853464.395574:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fd06f8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152082688:12345-0@lo:400: Request processed in 115us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853464.395594:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787853464.395787:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d7fcbcc2 x1874700152082688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853464.395802:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7fcbcc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152082688:0@lo:400: 10000000:01000000:0.0:1787853464.397834:0:5821:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787853464.397842:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9927436b6000 from 1 10000000:01000000:0.0:1787853464.397847:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787853464.397887:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: 00000000f764cebc/0xcf1365f7cb054649 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853464.397899:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: 00000000f764cebc/0xcf1365f7cb054649 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853464.397910:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: 00000000f764cebc/0xcf1365f7cb054649 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853464.398030:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036d7990f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152082816:0@lo:101: 00000100:00100000:0.0:1787853464.398099:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853464.398137:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set 0000000018475e0a going to sleep for 11 seconds 00000100:00100000:3.0:1787853464.399534:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152082816 00000100:00100000:3.0:1787853464.399546:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152082816 00000100:00100000:3.0:1787853464.399600:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787853464.399609:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1c4ed12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:5821:x1874700152082816:12345-0@lo:101: 00010000:00010000:3.0:1787853464.399623:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853464.399640:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000043a805f/0xcf1365f7cb054650 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb054649 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.399664:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000043a805f/0xcf1365f7cb054650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb054649 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.399689:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000043a805f/0xcf1365f7cb054650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054649 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.399713:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000043a805f, rc 0) 00000100:00100000:3.0:1787853464.399782:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1c4ed12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:5821:x1874700152082816:12345-0@lo:101: Request processed in 174us (1683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853464.399789:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787853464.400240:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036d7990f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152082816:0@lo:101: 00010000:00010000:2.0:1787853464.400264:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: 00000000f764cebc/0xcf1365f7cb054649 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054650 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.400280:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: 00000000f764cebc/0xcf1365f7cb054649 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054650 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853464.400351:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051a215ac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152082944:0@lo:501: 00000100:00100000:2.0:1787853464.400387:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853464.400426:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set 00000000385fd82d going to sleep for 11 seconds 00000100:00100000:3.0:1787853464.405287:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152082944 00000100:00100000:3.0:1787853464.405303:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152082944 00000100:00100000:3.0:1787853464.405371:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787853464.405380:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b54289ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:5821:x1874700152082944:12345-0@lo:501: 00000100:00100000:3.0:1787853464.405779:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b54289ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:5821:x1874700152082944:12345-0@lo:501: Request processed in 400us (5390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853464.405789:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787853464.406641:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051a215ac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152082944:0@lo:501: 00000100:00100000:2.0:1787853464.406722:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051a215ac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152083072:0@lo:503: 00000100:00100000:2.0:1787853464.407393:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853464.407443:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set 0000000007bd9096 going to sleep for 11 seconds 00000100:00100000:3.0:1787853464.408818:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152083072 00000100:00100000:3.0:1787853464.408830:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152083072 00000100:00100000:3.0:1787853464.409004:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787853464.409121:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030340cc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:5821:x1874700152083072:12345-0@lo:503: 00000100:00100000:3.0:1787853464.409738:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030340cc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:5821:x1874700152083072:12345-0@lo:503: Request processed in 724us (2345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853464.409748:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787853464.411572:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051a215ac pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152083072:0@lo:503: 00000100:00100000:0.0:1787853464.418772:0:6669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036d7990f pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6669:1874700152083200:0@lo:502: 00000100:00100000:0.0:1787853464.418858:0:6669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853464.419744:0:6669:0:(client.c:2715:ptlrpc_set_wait()) set 00000000943e1755 going to sleep for 11 seconds 00000100:00100000:3.0:1787853464.419745:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152083200 00000100:00100000:3.0:1787853464.419755:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152083200 00000100:00100000:3.0:1787853464.419817:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787853464.419827:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058ebd846 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:6669:x1874700152083200:12345-0@lo:502: 00000100:00100000:3.0:1787853464.420389:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058ebd846 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:6669:x1874700152083200:12345-0@lo:502: Request processed in 563us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853464.420398:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787853464.420509:0:6669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036d7990f pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6669:1874700152083200:0@lo:502: 00000020:01000000:0.0:1787853464.420542:0:6669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853464.420552:0:6669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853464.420555:0:6669:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787853464.420561:0:6669:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9927436b6000 00000020:00000080:0.0:1787853464.420564:0:6669:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787853464.420611:0:6669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6669:1874700152083328:0@lo:502: 00000100:00100000:0.0:1787853464.420652:0:6669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853464.420710:0:6669:0:(client.c:2715:ptlrpc_set_wait()) set ffff992748f6b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853464.421142:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152083328 00000100:00100000:3.0:1787853464.421149:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152083328 00000100:00100000:3.0:1787853464.421242:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787853464.421253:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:6669:x1874700152083328:12345-0@lo:502: 00000100:00100000:3.0:1787853464.421425:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:6669:x1874700152083328:12345-0@lo:502: Request processed in 174us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853464.421748:0:6669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6669:1874700152083328:0@lo:502: 00000020:01000000:2.0:1787853464.421781:0:6669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853464.421788:0:6669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853464.421790:0:6669:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787853464.421793:0:6669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000100:00100000:3.0:1787853464.431723:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000020:01000000:3.0:1787853464.431829:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787853464.431860:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787853464.431873:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb054649 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054650 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.431885:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb054649 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054650 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.455858:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787853464.672459:0:6667:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787853464.672465:0:6667:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787853464.672595:0:6667:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9927660b0000 00000020:01000004:2.0:1787853464.672611:0:6667:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787853464.672624:0:6667:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787853464.672638:0:6667:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99276de499d0) 00000020:00000080:2.0:1787853464.672653:0:6667:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787853464.691359:0:6667:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787853464.691604:0:6667:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787853464.715507:0:6667:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787853464.728582:0:6667:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787853464.728622:0:6667:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787853464.728772:0:6667:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787853464.728808:0:6667:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787853464.729267:0:6667:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787853464.729279:0:6667:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787853464.729289:0:6667:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf1365f7cb05465e 00000020:01000004:2.0:1787853464.729298:0:6667:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787853464.729319:0:6667:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.110@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787853464.729322:0:6667:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787853464.729328:0:6667:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787853464.729333:0:6667:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787853464.729344:0:6667:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99276de4cd70) 00000020:00000080:2.0:1787853464.729355:0:6667:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787853464.735285:0:6667:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787853464.735486:0:6667:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787853464.735497:0:6667:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787853464.739120:0:6667:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787853464.739133:0:6667:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787853464.739557:0:6667:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787853464.739565:0:6667:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787853464.745948:0:6667:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787853464.746376:0:6667:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787853464.746383:0:6667:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787853464.747162:0:6667:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787853464.747170:0:6667:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787853464.792202:0:6667:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787853464.792531:0:6667:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787853464.792537:0:6667:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787853464.799054:0:6667:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787853464.799069:0:6667:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787853464.800442:0:6667:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787853464.800456:0:6667:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787853464.803252:0:6667:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787853464.803451:0:6667:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787853464.803458:0:6667:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787853464.809825:0:6667:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787853464.810467:0:6667:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787853464.897610:0:6667:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787853464.897858:0:6667:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787853464.897865:0:6667:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787853464.900969:0:6667:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787853464.900981:0:6667:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787853464.901478:0:6667:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787853464.901504:0:6667:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787853464.901511:0:6667:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.110@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787853464.922906:0:6667:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787853464.922945:0:6667:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.110@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1787853464.922949:0:6667:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787853464.922951:0:6667:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787853464.922953:0:6667:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853464.922954:0:6667:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853464.922955:0:6667:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853464.922957:0:6667:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853464.922959:0:6667:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787853464.922960:0:6667:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787853464.922962:0:6667:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787853464.922963:0:6667:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853464.922965:0:6667:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787853464.922969:0:6667:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1787853464.922971:0:6667:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787853464.922972:0:6667:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787853464.922974:0:6667:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853464.922975:0:6667:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853464.922976:0:6667:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853464.922977:0:6667:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853464.922978:0:6667:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787853464.922980:0:6667:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787853464.922981:0:6667:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787853464.922982:0:6667:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853464.922983:0:6667:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787853464.923100:0:6667:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787853464.923119:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152083456:0@lo:253: 00000100:00100000:1.0:1787853464.923189:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853464.923316:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276604fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787853464.923411:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152083456 00000100:00100000:3.0:1787853464.923418:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152083456 00000100:00100000:3.0:1787853464.923515:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787853464.923525:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:6667:x1874700152083456:12345-0@lo:253: 20000000:01000000:3.0:1787853464.923572:0:5819:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787853464.923577:0:5819:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1787853464.923587:0:5819:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1787853464.923591:0:5819:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787853464.924745:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787853464.924973:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787853464.924989:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787853464.925134:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787853464.925145:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787853464.925183:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787853464.925239:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787853464.925631:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787853464.925652:0:5819:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.110@tcp 20000000:01000000:1.0:1787853464.925654:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.110@tcp (null) (null) (null) 00000040:00080000:1.0:1787853464.925736:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787853464.925745:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787853464.925795:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787853464.925802:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.110@tcp (null) (null) 00000040:00080000:1.0:1787853464.925833:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787853464.925842:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787853464.925871:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787853464.925918:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787853464.927395:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787853464.927421:0:5819:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.110@tcp 20000000:01000000:1.0:1787853464.927424:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.110@tcp (null) (null) (null) 00000040:00080000:1.0:1787853464.927460:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787853464.927468:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787853464.927496:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787853464.927504:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.110@tcp (null) (null) 00000040:00080000:1.0:1787853464.927549:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787853464.927559:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787853464.927604:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787853464.927656:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787853464.927942:0:5819:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1787853464.927946:0:5819:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1787853464.927952:0:5819:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787853464.927954:0:5819:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787853464.927957:0:5819:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787853464.927968:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787853464.927971:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787853464.928007:0:5819:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787853464.928009:0:5819:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787853464.928617:0:6684:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787853464.928867:0:6684:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787853464.928931:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787853464.929313:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787853464.929356:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787853464.929388:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1787853464.929400:0:5819:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787853464.929402:0:5819:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787853464.930008:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1787853464.930318:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1787853464.930354:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1787853464.930404:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1787853464.930415:0:5819:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787853464.930417:0:5819:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787853464.930909:0:6686:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787853464.930961:0:6686:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787853464.931097:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787853464.931330:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787853464.931363:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787853464.931412:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:1.0:1787853464.931429:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787853464.931448:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9927429f7400/0xcf1365f7cb05466c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.931465:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff992740030a00/0xcf1365f7cb054585 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05457e expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.931473:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99275064ce00/0xcf1365f7cb0545a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05459a expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.931493:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff992747f70400/0xcf1365f7cb054611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05460a expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.931500:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9927429f7400/0xcf1365f7cb05466c lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.931536:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff992747f70400/0xcf1365f7cb054611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb05460a expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.931549:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff992747f70400/0xcf1365f7cb054611 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb05460a expref: 12 pid: 5819 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853464.931565:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5819:1874700152083584:0@lo:104: 00000100:00100000:1.0:1787853464.931630:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787853464.931822:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99275064ce00/0xcf1365f7cb0545a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb05459a expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.931832:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99275064ce00/0xcf1365f7cb0545a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb05459a expref: 12 pid: 5819 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853464.931841:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5819:1874700152083712:0@lo:104: 00000100:00100000:1.0:1787853464.931865:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787853464.931993:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff992740030a00/0xcf1365f7cb054585 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb05457e expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.932002:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff992740030a00/0xcf1365f7cb054585 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb05457e expref: 12 pid: 5816 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853464.932010:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e69a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5819:1874700152083840:0@lo:104: 00000100:00100000:1.0:1787853464.932058:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853464.932174:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152083584 00000100:00100000:0.0:1787853464.932181:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152083584 00000100:00100000:0.0:1787853464.932233:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152083712 00000100:00100000:0.0:1787853464.932237:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152083712 00000100:00100000:0.0:1787853464.932251:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787853464.932259:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e68f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+4:5819:x1874700152083584:12345-0@lo:104: 00010000:00010000:0.0:1787853464.932271:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9927429f7c00/0xcf1365f7cb05460a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054611 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853464.932363:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787853464.932370:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e68f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+4:5819:x1874700152083584:12345-0@lo:104: Request processed in 111us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853464.932376:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787853464.932392:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787853464.932398:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:5819:x1874700152083712:12345-0@lo:104: 00010000:00010000:0.0:1787853464.932406:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff992747f71c00/0xcf1365f7cb05459a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0545a1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853464.932477:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276e832180 going to sleep for 11 seconds 00000100:00100000:1.0:1787853464.932496:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5819:1874700152083584:0@lo:104: 00000100:00100000:1.0:1787853464.932503:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5819:1874700152083712:0@lo:104: 00010000:00010000:3.0:1787853464.932538:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787853464.932545:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9927429f7c00/0xcf1365f7cb05460a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054611 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.932552:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927429f7c00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1787853464.932556:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9927429f7c00/0xcf1365f7cb05460a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb054611 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.932565:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9927429f7c00/0xcf1365f7cb05460a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb054611 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853464.932573:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9927429f7c00/0xcf1365f7cb05460a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb054611 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853464.932579:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787853464.932617:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9927429f7c00/0xcf1365f7cb05460a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054611 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.932624:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787853464.932643:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9927429f7c00/0xcf1365f7cb05460a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054611 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.932651:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9927429f7c00/0xcf1365f7cb05460a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054611 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.932704:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853464.932707:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff992747f71c00/0xcf1365f7cb05459a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0545a1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.932713:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71c00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1787853464.932715:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff992747f71c00/0xcf1365f7cb05459a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb0545a1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.932721:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff992747f71c00/0xcf1365f7cb05459a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb0545a1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853464.932727:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff992747f71c00/0xcf1365f7cb05459a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb0545a1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853464.932732:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787853464.932745:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff992747f71c00/0xcf1365f7cb05459a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0545a1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.932750:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787853464.932756:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff992747f71c00/0xcf1365f7cb05459a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0545a1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.932761:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff992747f71c00/0xcf1365f7cb05459a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0545a1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.932770:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853464.932772:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853464.932774:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853464.932786:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152084096:0@lo:103: 00000100:00100000:3.0:1787853464.932826:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853464.932857:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787853464.932863:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761eab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152083968:0@lo:103: 00000100:00100000:3.0:1787853464.932884:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787853464.933191:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1787853464.933199:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:5819:x1874700152083712:12345-0@lo:104: Request processed in 800us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853464.933206:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787853464.933222:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152083840 00000100:00100000:0.0:1787853464.933227:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152083840 00000100:00100000:0.0:1787853464.933247:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787853464.933253:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e6a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:5819:x1874700152083840:12345-0@lo:104: 00010000:00010000:0.0:1787853464.933261:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff992747f71a00/0xcf1365f7cb05457e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054585 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853464.934058:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e69a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5819:1874700152083840:0@lo:104: 00010000:00010000:1.0:1787853464.934086:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9927429f7400/0xcf1365f7cb05466c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853464.934255:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152084096 00000100:00100000:2.0:1787853464.934261:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152084096 00010000:00010000:2.0:1787853464.934286:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99275064ce00/0xcf1365f7cb0545a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb05459a expref: 13 pid: 5819 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853464.934308:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152083968 00000100:00100000:2.0:1787853464.934311:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152083968 00010000:00010000:2.0:1787853464.934322:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff992747f70400/0xcf1365f7cb054611 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb05460a expref: 14 pid: 5819 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853464.934335:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787853464.934342:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761eaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:3298:x1874700152084096:12345-0@lo:103: 00010000:00010000:2.0:1787853464.934352:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853464.934357:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99275064ce00/0xcf1365f7cb0545a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb05459a expref: 14 pid: 5819 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.934367:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99275064ce00/0xcf1365f7cb0545a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb05459a expref: 14 pid: 5819 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.934385:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99275064ce00/0xcf1365f7cb0545a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb05459a expref: 14 pid: 5819 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.934398:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853464.934432:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761eaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:3298:x1874700152084096:12345-0@lo:103: Request processed in 91us (1606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853464.934439:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787853464.934452:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787853464.934467:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761eab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:3298:x1874700152083968:12345-0@lo:103: 00010000:00010000:2.0:1787853464.934474:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853464.934478:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff992747f70400/0xcf1365f7cb054611 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb05460a expref: 12 pid: 5819 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.934488:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff992747f70400/0xcf1365f7cb054611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb05460a expref: 12 pid: 5819 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.934498:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992747f70400/0xcf1365f7cb054611 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb05460a expref: 12 pid: 5819 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.934507:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853464.934532:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761eab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:3298:x1874700152083968:12345-0@lo:103: Request processed in 66us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853464.934538:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787853464.934573:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761eab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152083968:0@lo:103: 00000100:00100000:2.0:1787853464.934582:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152084096:0@lo:103: 00010000:00010000:3.0:1787853464.934658:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853464.934666:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff992747f71a00/0xcf1365f7cb05457e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054585 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.934797:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71a00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1787853464.934803:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff992747f71a00/0xcf1365f7cb05457e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb054585 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.934811:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff992747f71a00/0xcf1365f7cb05457e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb054585 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853464.934819:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff992747f71a00/0xcf1365f7cb05457e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb054585 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853464.934825:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787853464.934896:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff992747f71a00/0xcf1365f7cb05457e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054585 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.934903:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787853464.934928:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff992747f71a00/0xcf1365f7cb05457e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054585 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.934935:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff992747f71a00/0xcf1365f7cb05457e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054585 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.934949:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853464.934956:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853464.934957:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853464.934965:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787853464.934977:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152084224:0@lo:103: 00000100:00100000:3.0:1787853464.935121:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853464.935193:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152084224 00000100:00100000:2.0:1787853464.935198:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152084224 00010000:00010000:2.0:1787853464.935218:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff992740030a00/0xcf1365f7cb054585 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb05457e expref: 11 pid: 5816 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853464.935245:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787853464.935253:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761eaa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:3300:x1874700152084224:12345-0@lo:103: 00010000:00010000:2.0:1787853464.935262:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853464.935266:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff992740030a00/0xcf1365f7cb054585 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb05457e expref: 11 pid: 5816 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.935285:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff992740030a00/0xcf1365f7cb054585 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb05457e expref: 11 pid: 5816 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.935296:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992740030a00/0xcf1365f7cb054585 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb05457e expref: 11 pid: 5816 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.935310:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9927429f7400/0xcf1365f7cb05466c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.935318:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927429f7400/0xcf1365f7cb05466c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.935333:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9927429f7400/0xcf1365f7cb05466c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.935340:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9927429f7400/0xcf1365f7cb05466c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.935346:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9927429f7400/0xcf1365f7cb05466c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.935352:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9927429f7400/0xcf1365f7cb05466c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.935357:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927429f7400 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853464.935360:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9927429f7400/0xcf1365f7cb05466c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.935367:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9927429f7400/0xcf1365f7cb05466c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.935392:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9927429f7400/0xcf1365f7cb05466c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.935402:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853464.935432:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761eaa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+10:3300:x1874700152084224:12345-0@lo:103: Request processed in 180us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853464.935438:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787853464.935465:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152084224:0@lo:103: 00010000:00010000:2.0:1787853464.935487:0:5819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9927429f7400/0xcf1365f7cb05466c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.935495:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9927429f7400/0xcf1365f7cb05466c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853464.935502:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927429f7400/0xcf1365f7cb05466c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787853464.935514:0:5819:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1787853464.935969:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1787853464.935983:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e6a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:5819:x1874700152083840:12345-0@lo:104: Request processed in 2729us (3924us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853464.935991:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787853464.936109:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853464.991033:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+9:6667:x1874700152083456:12345-0@lo:253: Request processed in 67487us (67821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853464.991049:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787853464.991197:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152083456:0@lo:253: 10000000:01000000:1.0:1787853464.991213:0:6667:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787853464.991217:0:6667:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787853464.991219:0:6667:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787853464.991220:0:6667:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853464.991221:0:6667:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787853464.991222:0:6667:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853464.991224:0:6667:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853464.991225:0:6667:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787853464.991227:0:6667:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787853464.991228:0:6667:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853464.991230:0:6667:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787853464.991253:0:6667:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9927660b0000 from lustre-OST0000 10000000:01000000:1.0:1787853464.991278:0:6667:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787853464.991281:0:6667:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787853464.991288:0:6667:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99274364b3a0 local copy 10000000:01000000:1.0:1787853464.991292:0:6667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787853464.991327:0:6667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f7600/0xcf1365f7cb054673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.991339:0:6667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.110@tcp lock: ffff9927429f7600/0xcf1365f7cb054673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.991348:0:6667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927429f7600/0xcf1365f7cb054673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853464.991379:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152084352:0@lo:101: 00000100:00100000:1.0:1787853464.991412:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853464.991493:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276e832300 going to sleep for 11 seconds 00000100:00100000:0.0:1787853464.991580:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152084352 00000100:00100000:0.0:1787853464.991586:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152084352 00000100:00100000:0.0:1787853464.991669:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787853464.991695:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+9:6667:x1874700152084352:12345-0@lo:101: 00010000:00010000:0.0:1787853464.991708:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853464.991721:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992740031800/0xcf1365f7cb05467a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb054673 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853464.991742:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992740031800/0xcf1365f7cb05467a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb054673 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853464.991752:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992740031800/0xcf1365f7cb05467a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054673 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853464.991762:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992740031800, rc 0) 00000100:00100000:0.0:1787853464.991799:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+10:6667:x1874700152084352:12345-0@lo:101: Request processed in 105us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853464.991805:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787853464.991958:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e6b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152084352:0@lo:101: 00010000:00010000:3.0:1787853464.991970:0:6667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927429f7600/0xcf1365f7cb054673 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcf1365f7cb05467a expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.991979:0:6667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927429f7600/0xcf1365f7cb054673 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf1365f7cb05467a expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853464.992088:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761eab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152084480:0@lo:501: 00000100:00100000:3.0:1787853464.992113:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853464.992282:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274586f900 going to sleep for 11 seconds 00000100:00100000:1.0:1787853464.992345:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152084480 00000100:00100000:1.0:1787853464.992349:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152084480 00000100:00100000:1.0:1787853464.992369:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787853464.992375:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+10:6667:x1874700152084480:12345-0@lo:501: 00000100:00100000:1.0:1787853464.992559:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+10:6667:x1874700152084480:12345-0@lo:501: Request processed in 183us (444us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787853464.992566:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787853464.992634:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761eab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152084480:0@lo:501: 10000000:01000000:3.0:1787853464.992646:0:6667:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787853464.992669:0:6667:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787853464.992688:0:6667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f7600/0xcf1365f7cb054673 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf1365f7cb05467a expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.992697:0:6667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f7600/0xcf1365f7cb054673 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf1365f7cb05467a expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.992704:0:6667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9927429f7600/0xcf1365f7cb054673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf1365f7cb05467a expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.992724:0:6667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787853464.992749:0:6667:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9927660b0000 10000000:01000000:3.0:1787853464.992754:0:6667:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787853464.992758:0:6667:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99274364b3a0 10000000:01000000:3.0:1787853464.992761:0:6667:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787853464.992764:0:6667:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99274364b3a0 from 1 10000000:01000000:3.0:1787853464.992767:0:6667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787853464.992783:0:6667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff99275064c400/0xcf1365f7cb054681 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.992791:0:6667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff99275064c400/0xcf1365f7cb054681 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.992799:0:6667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff99275064c400/0xcf1365f7cb054681 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853464.992809:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761eab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152084608:0@lo:101: 00000100:00100000:3.0:1787853464.992831:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853464.992841:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274586f3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787853464.992888:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853464.992895:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9927429f7600/0xcf1365f7cb054673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcf1365f7cb05467a expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.992903:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927429f7600 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:1.0:1787853464.992907:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9927429f7600/0xcf1365f7cb054673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcf1365f7cb05467a expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.992916:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9927429f7600/0xcf1365f7cb054673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xcf1365f7cb05467a expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787853464.992924:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9927429f7600/0xcf1365f7cb054673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xcf1365f7cb05467a expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853464.992930:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787853464.992946:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9927429f7600/0xcf1365f7cb054673 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf1365f7cb05467a expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.992961:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787853464.992985:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9927429f7600/0xcf1365f7cb054673 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf1365f7cb05467a expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.992993:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9927429f7600/0xcf1365f7cb054673 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf1365f7cb05467a expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.993006:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853464.993008:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853464.993009:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853464.993086:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787853464.993097:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152084736:0@lo:103: 00000100:00100000:1.0:1787853464.993123:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853464.993154:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152084736 00000100:00100000:1.0:1787853464.993157:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152084736 00000100:00100000:1.0:1787853464.993183:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787853464.993189:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e68780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+10:3299:x1874700152084736:12345-0@lo:103: 00010000:00010000:1.0:1787853464.993198:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853464.993210:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992740031800/0xcf1365f7cb05467a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf1365f7cb054673 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.993221:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853464.993244:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e68780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+9:3299:x1874700152084736:12345-0@lo:103: Request processed in 55us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853464.993251:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787853464.993271:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152084736:0@lo:103: 00000100:00100000:1.0:1787853464.993287:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152084608 00000100:00100000:1.0:1787853464.993295:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152084608 00000100:00100000:1.0:1787853464.993308:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787853464.993313:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+9:6667:x1874700152084608:12345-0@lo:101: 00010000:00010000:1.0:1787853464.993321:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853464.993329:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927429f6e00/0xcf1365f7cb054688 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb054681 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.993342:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927429f6e00/0xcf1365f7cb054688 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb054681 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.993350:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927429f6e00/0xcf1365f7cb054688 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054681 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.993356:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927429f6e00, rc 0) 00000100:00100000:1.0:1787853464.993378:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+10:6667:x1874700152084608:12345-0@lo:101: Request processed in 65us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853464.993383:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787853464.993451:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761eab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152084608:0@lo:101: 00010000:00010000:3.0:1787853464.993461:0:6667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff99275064c400/0xcf1365f7cb054681 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054688 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.993469:0:6667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff99275064c400/0xcf1365f7cb054681 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054688 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853464.993483:0:6667:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787853464.993496:0:6667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff99275064c400/0xcf1365f7cb054681 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054688 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.993504:0:6667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff99275064c400/0xcf1365f7cb054681 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054688 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853464.993517:0:6667:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787853464.993520:0:6667:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787853464.993525:0:6667:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787853464.993527:0:6667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787853464.993540:0:6667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb05468f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.993548:0:6667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb05468f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.993555:0:6667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb05468f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853464.993565:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761eab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152084864:0@lo:101: 00000100:00100000:3.0:1787853464.993586:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853464.993596:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274586f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853464.993706:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152084864 00000100:00100000:1.0:1787853464.993710:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152084864 00000100:00100000:1.0:1787853464.993724:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787853464.993729:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+10:6667:x1874700152084864:12345-0@lo:101: 00010000:00010000:1.0:1787853464.993735:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853464.993742:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927429f7a00/0xcf1365f7cb054696 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb05468f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.993753:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927429f7a00/0xcf1365f7cb054696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb05468f expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.993761:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927429f7a00/0xcf1365f7cb054696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05468f expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853464.993778:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927429f7a00, rc 0) 00000100:00100000:1.0:1787853464.993799:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:6667:x1874700152084864:12345-0@lo:101: Request processed in 70us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853464.993805:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787853464.993864:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761eab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152084864:0@lo:101: 00010000:00010000:3.0:1787853464.993873:0:6667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb05468f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054696 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853464.993881:0:6667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb05468f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054696 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853464.993941:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761eab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152084992:0@lo:501: 00000100:00100000:3.0:1787853464.993963:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853464.993986:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274586f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853464.994097:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152084992 00000100:00100000:1.0:1787853464.994101:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152084992 00000100:00100000:1.0:1787853464.994116:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787853464.994121:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:6667:x1874700152084992:12345-0@lo:501: 00000100:00100000:1.0:1787853464.994314:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:6667:x1874700152084992:12345-0@lo:501: Request processed in 192us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853464.994321:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787853464.994446:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761eab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152084992:0@lo:501: 00000100:00100000:3.0:1787853464.994479:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761eab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152085120:0@lo:503: 00000100:00100000:3.0:1787853464.994518:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853464.994539:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274586f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853464.994581:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152085120 00000100:00100000:1.0:1787853464.994586:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152085120 00000100:00100000:1.0:1787853464.994614:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787853464.994620:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:6667:x1874700152085120:12345-0@lo:503: 00000100:00100000:1.0:1787853464.995142:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:6667:x1874700152085120:12345-0@lo:503: Request processed in 521us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853464.995149:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787853464.995227:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761eab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152085120:0@lo:503: 00000040:00080000:3.0:1787853464.995505:0:6667:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787853464.995578:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761eab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152085248:0@lo:502: 00000100:00100000:3.0:1787853464.995615:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853464.995650:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274586f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853464.995720:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152085248 00000100:00100000:0.0:1787853464.995726:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152085248 00000100:00100000:0.0:1787853464.995754:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787853464.995760:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:6667:x1874700152085248:12345-0@lo:502: 00000100:00100000:0.0:1787853464.995897:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:6667:x1874700152085248:12345-0@lo:502: Request processed in 136us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853464.995904:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787853464.996141:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761eab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152085248:0@lo:502: 00000040:00080000:3.0:1787853464.996415:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787853464.996466:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787853464.996503:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787853464.996553:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787853464.996593:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787853464.996628:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787853464.996654:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761eab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152085376:0@lo:502: 00000100:00100000:3.0:1787853464.996711:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853464.996745:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274586f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853464.996949:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152085376 00000100:00100000:0.0:1787853464.996960:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152085376 00000100:00100000:0.0:1787853464.996994:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787853464.997002:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:6667:x1874700152085376:12345-0@lo:502: 00000100:00100000:0.0:1787853464.997256:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:6667:x1874700152085376:12345-0@lo:502: Request processed in 254us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853464.997263:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787853464.997347:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761eab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152085376:0@lo:502: 00000040:00080000:3.0:1787853464.997430:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787853464.997440:0:6667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1787853464.998163:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787853464.998172:0:6688:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787853464.998179:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853464.998181:0:6688:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787853464.998187:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787853464.998202:0:6688:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99276e8233a0) 00000020:00000080:1.0:1787853464.998223:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787853464.998229:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787853464.998305:0:6688:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9927660b0000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787853464.998319:0:6688:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787853464.998326:0:6688:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf1365f7cb0546a4 00010000:00010000:0.0:1787853465.013061:0:6688:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1787853465.013388:0:6688:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1787853465.021846:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787853465.022240:0:6688:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787853465.033140:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787853465.033612:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1787853465.040103:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787853465.040116:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853465.040122:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853465.040124:0:6688:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787853465.040127:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853465.040131:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853465.040133:0:6688:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787853465.040135:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787853465.040137:0:6688:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787853465.040196:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853465.040200:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853465.040202:0:6688:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787853465.040206:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787853465.040422:0:6667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787853465.040448:0:6667:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787853465.040469:0:6667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb05468f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054696 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853465.040490:0:6667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb05468f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054696 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853465.040499:0:6667:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9927660b0000 from 1 10000000:01000000:0.0:1787853465.040502:0:6667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787853465.040539:0:6667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992740031600/0xcf1365f7cb0546ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853465.040547:0:6667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992740031600/0xcf1365f7cb0546ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853465.040558:0:6667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992740031600/0xcf1365f7cb0546ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853465.040592:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152085504:0@lo:101: 00000100:00100000:0.0:1787853465.040659:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853465.040737:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927457fe900 going to sleep for 11 seconds 00000100:00100000:1.0:1787853465.040865:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152085504 00000100:00100000:1.0:1787853465.040873:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152085504 00000100:00100000:1.0:1787853465.040950:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787853465.040960:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:6667:x1874700152085504:12345-0@lo:101: 00010000:00010000:1.0:1787853465.040973:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853465.040987:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927429f7600/0xcf1365f7cb0546b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0546ab expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853465.041007:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927429f7600/0xcf1365f7cb0546b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0546ab expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853465.041033:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927429f7600/0xcf1365f7cb0546b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0546ab expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853465.041041:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927429f7600, rc 0) 00000100:00100000:1.0:1787853465.041079:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:6667:x1874700152085504:12345-0@lo:101: Request processed in 121us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853465.041095:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787853465.045995:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152085504:0@lo:101: 00010000:00010000:0.0:1787853465.046098:0:6667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992740031600/0xcf1365f7cb0546ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0546b2 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853465.046112:0:6667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992740031600/0xcf1365f7cb0546ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0546b2 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853465.046249:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152085632:0@lo:501: 00000100:00100000:0.0:1787853465.046310:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853465.047706:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927457fe900 going to sleep for 11 seconds 00000100:00100000:1.0:1787853465.047816:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152085632 00000100:00100000:1.0:1787853465.047824:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152085632 00000100:00100000:1.0:1787853465.047881:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787853465.047891:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:6667:x1874700152085632:12345-0@lo:501: 00000100:00100000:1.0:1787853465.048173:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:6667:x1874700152085632:12345-0@lo:501: Request processed in 284us (1861us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853465.048181:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787853465.048756:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152085632:0@lo:501: 00000100:00100000:0.0:1787853465.048808:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152085760:0@lo:503: 00000100:00100000:0.0:1787853465.048857:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853465.048887:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927457fe900 going to sleep for 11 seconds 00000100:00100000:1.0:1787853465.049601:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152085760 00000100:00100000:1.0:1787853465.049609:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152085760 00000100:00100000:1.0:1787853465.049662:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787853465.049688:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:6667:x1874700152085760:12345-0@lo:503: 00000100:00100000:1.0:1787853465.049899:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:6667:x1874700152085760:12345-0@lo:503: Request processed in 229us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853465.049906:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787853465.050086:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152085760:0@lo:503: 00000040:00080000:0.0:1787853465.050740:0:6667:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787853465.050813:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152085888:0@lo:502: 00000100:00100000:0.0:1787853465.050864:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853465.050901:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927457fe900 going to sleep for 11 seconds 00000100:00100000:3.0:1787853465.051133:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152085888 00000100:00100000:3.0:1787853465.051140:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152085888 00000100:00100000:3.0:1787853465.051177:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787853465.051187:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:6667:x1874700152085888:12345-0@lo:502: 00000100:00100000:3.0:1787853465.051367:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:6667:x1874700152085888:12345-0@lo:502: Request processed in 181us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853465.051380:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787853465.052178:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152085888:0@lo:502: 00000040:00080000:0.0:1787853465.052469:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787853465.053206:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787853465.053246:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152086016:0@lo:502: 00000100:00100000:0.0:1787853465.053306:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853465.053337:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927457fe900 going to sleep for 11 seconds 00000100:00100000:3.0:1787853465.053413:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152086016 00000100:00100000:3.0:1787853465.053419:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152086016 00000100:00100000:3.0:1787853465.053464:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787853465.053619:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:6667:x1874700152086016:12345-0@lo:502: 00000100:00100000:3.0:1787853465.054344:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:6667:x1874700152086016:12345-0@lo:502: Request processed in 870us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853465.054352:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787853465.054455:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152086016:0@lo:502: 00000040:00080000:0.0:1787853465.054837:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787853465.054851:0:6667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787853465.059211:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787853465.059224:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853465.059226:0:6692:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787853465.059232:0:6692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9927660b0000 00000020:00000080:2.0:1787853465.059235:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787853465.059256:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853465.059260:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853465.059272:0:6692:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787853465.059275:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787853465.059403:0:6667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787853465.059436:0:6667:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787853465.059509:0:6667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992740031600/0xcf1365f7cb0546ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0546b2 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853465.059522:0:6667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992740031600/0xcf1365f7cb0546ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0546b2 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853465.059564:0:6667:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787853465.059567:0:6667:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9927660b0000 10000000:01000000:0.0:1787853465.059570:0:6667:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9927660b0000 10000000:01000000:0.0:1787853465.059574:0:6667:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787853465.059579:0:6667:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9927660b0000 from 1 10000000:01000000:0.0:1787853465.059581:0:6667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787853465.059614:0:6667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb0546b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853465.059622:0:6667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb0546b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853465.059634:0:6667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb0546b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853465.059668:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152086144:0@lo:101: 00000100:00100000:0.0:1787853465.059764:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853465.059806:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927457fe240 going to sleep for 11 seconds 00000100:00100000:2.0:1787853465.059900:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152086144 00000100:00100000:2.0:1787853465.059907:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152086144 00000100:00100000:2.0:1787853465.059951:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787853465.059961:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:6667:x1874700152086144:12345-0@lo:101: 00010000:00010000:2.0:1787853465.059974:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853465.059987:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992747f70400/0xcf1365f7cb0546c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0546b9 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853465.060009:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992747f70400/0xcf1365f7cb0546c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0546b9 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853465.060031:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992747f70400/0xcf1365f7cb0546c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0546b9 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853465.060039:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70400, rc 0) 00000100:00100000:2.0:1787853465.060078:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:6667:x1874700152086144:12345-0@lo:101: Request processed in 119us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853465.060084:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787853465.060203:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152086144:0@lo:101: 00010000:00010000:0.0:1787853465.060217:0:6667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb0546b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0546c0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853465.060225:0:6667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb0546b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0546c0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853465.060315:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152086272:0@lo:501: 00000100:00100000:0.0:1787853465.060341:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853465.060365:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927457fe240 going to sleep for 11 seconds 00000100:00100000:2.0:1787853465.060407:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152086272 00000100:00100000:2.0:1787853465.060411:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152086272 00000100:00100000:2.0:1787853465.060444:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787853465.060451:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:6667:x1874700152086272:12345-0@lo:501: 00000100:00100000:2.0:1787853465.060718:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:6667:x1874700152086272:12345-0@lo:501: Request processed in 267us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853465.060726:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787853465.060773:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152086272:0@lo:501: 00000100:00100000:2.0:1787853465.060798:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa29a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152086400:0@lo:503: 00000100:00100000:2.0:1787853465.060838:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853465.060849:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff992766169c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787853465.061039:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152086400 00000100:00100000:0.0:1787853465.061045:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152086400 00000100:00100000:0.0:1787853465.061077:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787853465.061084:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:6667:x1874700152086400:12345-0@lo:503: 00000100:00100000:0.0:1787853465.061243:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:6667:x1874700152086400:12345-0@lo:503: Request processed in 159us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853465.061249:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787853465.061324:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa29a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152086400:0@lo:503: 00000040:00080000:1.0:1787853465.061610:0:6667:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787853465.061668:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e69a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152086528:0@lo:502: 00000100:00100000:1.0:1787853465.061776:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853465.061804:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff99275178d780 going to sleep for 11 seconds 00000100:00100000:0.0:1787853465.061936:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152086528 00000100:00100000:0.0:1787853465.061941:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152086528 00000100:00100000:0.0:1787853465.061974:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787853465.061981:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:6667:x1874700152086528:12345-0@lo:502: 00000100:00100000:0.0:1787853465.062149:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:6667:x1874700152086528:12345-0@lo:502: Request processed in 168us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853465.062165:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787853465.062241:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e69a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152086528:0@lo:502: 00000040:00080000:1.0:1787853465.062534:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787853465.062584:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787853465.062617:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787853465.062663:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787853465.062886:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787853465.062960:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787853465.062994:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787853465.063041:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787853465.063102:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787853465.063136:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787853465.063162:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787853465.063200:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787853465.063236:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787853465.063269:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787853465.063331:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787853465.063367:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787853465.063401:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787853465.063445:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787853465.063821:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787853465.063865:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787853465.063916:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787853465.063950:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787853465.063982:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787853465.064054:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787853465.064094:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787853465.064126:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787853465.064172:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787853465.064205:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1787853465.064249:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e69a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152086656:0@lo:502: 00000100:00100000:1.0:1787853465.064322:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853465.064409:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff99275178d780 going to sleep for 11 seconds 00000100:00100000:0.0:1787853465.064456:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152086656 00000100:00100000:0.0:1787853465.064464:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152086656 00000100:00100000:0.0:1787853465.064655:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787853465.064666:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:6667:x1874700152086656:12345-0@lo:502: 00000100:00100000:0.0:1787853465.065570:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:6667:x1874700152086656:12345-0@lo:502: Request processed in 903us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853465.065580:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787853465.065713:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e69a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152086656:0@lo:502: 00000040:00080000:2.0:1787853465.065817:0:6667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787853465.065832:0:6667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787853465.066377:0:6693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787853465.066396:0:6693:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9927500db3a0) 00000020:00000080:3.0:1787853465.066420:0:6693:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1787853465.066520:0:6693:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9927660b0000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787853465.066524:0:6693:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9927660b0000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787853465.066527:0:6693:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9927660b0000 3 00010000:00080000:3.0:1787853465.066557:0:6693:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9926417ea800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.110@tcp at head 00010000:00010000:2.0:1787853465.069066:0:6693:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1787853465.069323:0:6693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787853465.069363:0:6693:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787853465.069374:0:6693:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcf1365f7cb0546ce 00000100:00080000:2.0:1787853465.069384:0:6693:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787853465.069390:0:6693:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9926417ea800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:2.0:1787853465.069424:0:6693:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99275aa283c0 x1874700152086784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787853465.069450:0:6693:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787853465.069504:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787853465.069518:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152086912:0@lo:400: 00000100:00100000:2.0:1787853465.069582:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853465.069644:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152086912 00000100:00100000:2.0:1787853465.069650:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152086912 00000100:00100000:2.0:1787853465.069712:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787853465.069722:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99275aa28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152086912:12345-0@lo:400: 00000100:00100000:2.0:1787853465.069772:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99275aa28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152086912:12345-0@lo:400: Request processed in 52us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853465.069779:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787853465.069814:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99275aa292c0 x1874700152086912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853465.069827:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152086912:0@lo:400: 00000100:00100000:1.0:1787853465.070044:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3296:1874700152086784:0@lo:38: 00000100:00100000:1.0:1787853465.070079:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853465.070125:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152086784 00000100:00100000:1.0:1787853465.070130:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152086784 00000100:00100000:1.0:1787853465.070150:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787853465.070160:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3296:x1874700152086784:12345-0@lo:38: 00010000:00080000:1.0:1787853465.070179:0:5826:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:1.0:1787853465.070208:0:5826:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcf1365f7cb0546d5 00000004:00100000:1.0:1787853465.070223:0:5826:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787853465.070251:0:5826:0:(import.c:65:import_set_state_nolock()) ffff992641d66800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787853465.070290:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874700152086784:12345-0@lo:38: Request processed in 128us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853465.070296:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787853465.070321:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99275aa283c0 x1874700152086784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787853475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853465.070329:0:3296:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787853465.070335:0:3296:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787853465.070341:0:3296:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787853465.070345:0:3296:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787853465.070348:0:3296:0:(import.c:65:import_set_state_nolock()) ffff9926417ea800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787853465.070352:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3296:1874700152086784:0@lo:38: 00000040:00080000:2.0:1787853465.070590:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1787853465.073218:0:6667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787853465.073266:0:6667:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787853465.073335:0:6667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb0546b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0546c0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.073348:0:6667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb0546b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0546c0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787853465.073750:0:6667:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787853465.073752:0:6667:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787853465.073754:0:6667:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787853465.073755:0:6667:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787853465.073756:0:6667:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787853465.073757:0:6667:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787853465.073760:0:6667:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787853465.073766:0:6667:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787853465.073768:0:6667:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787853465.073770:0:6667:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787853465.073771:0:6667:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787853465.073775:0:6667:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787853465.073777:0:6667:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787853465.073778:0:6667:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787853465.073779:0:6667:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787853465.073780:0:6667:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787853465.073781:0:6667:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787853465.073782:0:6667:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787853465.073783:0:6667:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787853465.073784:0:6667:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787853465.073784:0:6667:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787853465.073785:0:6667:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787853465.073786:0:6667:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787853465.073810:0:6667:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787853465.073829:0:6667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761eab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152087040:0@lo:253: 00000100:00100000:3.0:1787853465.073899:0:6667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853465.073942:0:6667:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274586f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787853465.074034:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152087040 00000100:00100000:0.0:1787853465.074042:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152087040 00000100:00100000:0.0:1787853465.074089:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787853465.074098:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:6667:x1874700152087040:12345-0@lo:253: 20000000:01000000:0.0:1787853465.074126:0:5819:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787853465.074140:0:5819:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787853465.113217:0:5819:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787853465.113239:0:5819:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787853465.113306:0:5840:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787853465.113311:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787853465.113334:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99275064cc00/0xcf1365f7cb0546dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.113354:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff992747f71000/0xcf1365f7cb05463b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054634 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.113363:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99275064cc00/0xcf1365f7cb0546dc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.113402:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff992747f71000/0xcf1365f7cb05463b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb054634 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.113418:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff992747f71000/0xcf1365f7cb05463b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb054634 expref: 13 pid: 5819 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853465.113451:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea9a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5840:1874700152087168:0@lo:104: 00000100:00100000:3.0:1787853465.113519:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853465.113575:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274335fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787853465.114044:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152087168 00000100:00100000:2.0:1787853465.114052:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152087168 00000100:00100000:2.0:1787853465.114111:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787853465.114121:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761eabc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:5840:x1874700152087168:12345-0@lo:104: 00010000:00010000:2.0:1787853465.114135:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb05463b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853465.114368:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea9a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5840:1874700152087168:0@lo:104: 00010000:00010000:3.0:1787853465.114392:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99275064cc00/0xcf1365f7cb0546dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853465.114487:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787853465.114494:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761eabc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:5840:x1874700152087168:12345-0@lo:104: Request processed in 376us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853465.114503:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787853465.114566:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853465.114572:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb05463b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.114580:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031400 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1787853465.114585:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb05463b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.114593:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb05463b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853465.114601:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb05463b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853465.114608:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787853465.114645:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054634 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb05463b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.114651:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787853465.114702:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054634 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb05463b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.114724:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054634 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb05463b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.114742:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853465.114744:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853465.114746:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853465.114755:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853465.114768:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152087296:0@lo:103: 00000100:00100000:3.0:1787853465.114806:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853465.114846:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152087296 00000100:00100000:3.0:1787853465.114851:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152087296 00010000:00010000:3.0:1787853465.114871:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff992747f71000/0xcf1365f7cb05463b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb054634 expref: 14 pid: 5819 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853465.114895:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787853465.114902:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274415e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:3297:x1874700152087296:12345-0@lo:103: 00010000:00010000:3.0:1787853465.114912:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853465.114917:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff992747f71000/0xcf1365f7cb05463b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb054634 expref: 14 pid: 5819 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.114927:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff992747f71000/0xcf1365f7cb05463b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb054634 expref: 14 pid: 5819 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.114940:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992747f71000/0xcf1365f7cb05463b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb054634 expref: 14 pid: 5819 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.114953:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99275064cc00/0xcf1365f7cb0546dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.114971:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99275064cc00/0xcf1365f7cb0546dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787853465.114986:0:5810:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002119374s 00010000:00010000:3.0:1787853465.114990:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99275064cc00/0xcf1365f7cb0546dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.114997:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99275064cc00/0xcf1365f7cb0546dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.115004:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99275064cc00/0xcf1365f7cb0546dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.115025:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99275064cc00/0xcf1365f7cb0546dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.115031:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064cc00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:3.0:1787853465.115035:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99275064cc00/0xcf1365f7cb0546dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.115042:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99275064cc00/0xcf1365f7cb0546dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.115056:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99275064cc00/0xcf1365f7cb0546dc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.115066:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853465.115096:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274415e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:3297:x1874700152087296:12345-0@lo:103: Request processed in 195us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853465.115103:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787853465.115168:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152087296:0@lo:103: 00010000:00010000:3.0:1787853465.115186:0:5840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99275064cc00/0xcf1365f7cb0546dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.115194:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99275064cc00/0xcf1365f7cb0546dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853465.115410:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99275064cc00/0xcf1365f7cb0546dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853465.125218:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:6667:x1874700152087040:12345-0@lo:253: Request processed in 51112us (51310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853465.125234:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787853465.125322:0:6667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761eab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:6667:1874700152087040:0@lo:253: 10000000:01000000:3.0:1787853465.125338:0:6667:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787853465.125341:0:6667:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787853465.125344:0:6667:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787853465.125345:0:6667:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787853465.125346:0:6667:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787853465.125347:0:6667:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787853465.125348:0:6667:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787853465.125350:0:6667:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787853465.125352:0:6667:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787853465.125353:0:6667:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787853465.125356:0:6667:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787853465.125357:0:6667:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787853465.125374:0:6667:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787853465.130206:0:6667:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787853465.130379:0:6667:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787853465.130574:0:6667:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787853465.130860:0:6667:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787853465.131104:0:6667:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787853465.131313:0:6667:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787853465.132262:0:6667:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787853465.311740:0:6667:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787853465.311748:0:6667:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787853465.311781:0:6667:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787853465.311843:0:6667:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.110@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787853465.311858:0:6667:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787853465.311887:0:6667:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787853465.479615:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853466.506521:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853467.528937:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853468.552051:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853469.577013:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853470.533843:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787853470.533870:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa28780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1874700152087680:0@lo:400: 00000100:00100000:3.0:1787853470.533879:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152087424:0@lo:400: 00000100:00100000:3.0:1787853470.533941:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853470.533955:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853470.534014:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787853470.534025:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152087552:0@lo:400: 00000100:00100000:3.0:1787853470.534051:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853470.534506:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152087680 00000100:00100000:2.0:1787853470.534514:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152087680 00000100:00100000:2.0:1787853470.534582:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152087552 00000100:00100000:2.0:1787853470.534585:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152087552 00000100:00100000:2.0:1787853470.534603:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787853470.534611:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99275aa292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874700152087680:12345-0@lo:400: 00000100:00100000:2.0:1787853470.534700:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99275aa292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874700152087680:12345-0@lo:400: Request processed in 89us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853470.534708:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787853470.534725:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787853470.534732:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761eaa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152087552:12345-0@lo:400: 00000100:00100000:2.0:1787853470.534764:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761eaa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152087552:12345-0@lo:400: Request processed in 33us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853470.534771:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787853470.534805:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99275aa28780 x1874700152087680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853470.534820:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa28780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1874700152087680:0@lo:400: 00010000:00080000:2.0:1787853470.535114:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99275aa2a580 x1874700152087552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853470.535124:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152087552:0@lo:400: 00000100:00100000:3.0:1787853470.535398:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152087424 00000100:00100000:3.0:1787853470.535406:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152087424 00000100:00100000:3.0:1787853470.535453:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787853470.535460:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:3299:x1874700152087424:12345-0@lo:400: 00000100:00100000:3.0:1787853470.535507:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:3299:x1874700152087424:12345-0@lo:400: Request processed in 48us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853470.535514:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787853470.535547:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152087424:0@lo:400: 00000100:00080000:3.0:1787853470.535692:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787853470.601281:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787853471.446742:0:7036:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787853471.625623:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853472.653884:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787853473.098844:0:5821:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787853473.098853:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9927436b6000 from 21 10000000:01000000:3.0:1787853473.098857:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787853473.098902:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff99275064d600/0xcf1365f7cb0546e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853473.098915:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff99275064d600/0xcf1365f7cb0546e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853473.098925:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff99275064d600/0xcf1365f7cb0546e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853473.098947:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152087808:0@lo:101: 00000100:00100000:3.0:1787853473.099340:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853473.099387:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927660f9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787853473.100584:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152087808 00000100:00100000:0.0:1787853473.100594:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152087808 00000100:00100000:0.0:1787853473.100643:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787853473.100654:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:5821:x1874700152087808:12345-0@lo:101: 00010000:00010000:0.0:1787853473.100669:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853473.100706:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992740031800/0xcf1365f7cb0546ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0546e3 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853473.100731:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992740031800/0xcf1365f7cb0546ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0546e3 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853473.100751:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992740031800/0xcf1365f7cb0546ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0546e3 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853473.100759:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992740031800, rc 0) 00000100:00100000:0.0:1787853473.100822:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:5821:x1874700152087808:12345-0@lo:101: Request processed in 170us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853473.100829:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787853473.100894:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152087808:0@lo:101: 00010000:00010000:0.0:1787853473.100910:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff99275064d600/0xcf1365f7cb0546e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0546ea expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853473.100919:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff99275064d600/0xcf1365f7cb0546e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0546ea expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853473.101000:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152087936:0@lo:501: 00000100:00100000:0.0:1787853473.101028:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853473.101047:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152087936 00000100:00100000:0.0:1787853473.101056:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d1de540 going to sleep for 11 seconds 00000100:00100000:1.0:1787853473.101057:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152087936 00000100:00100000:1.0:1787853473.101083:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787853473.101090:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:5821:x1874700152087936:12345-0@lo:501: 00000100:00100000:1.0:1787853473.109755:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:5821:x1874700152087936:12345-0@lo:501: Request processed in 8654us (8714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853473.109771:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787853473.109900:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152087936:0@lo:501: 00000100:00100000:0.0:1787853473.109981:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152088064:0@lo:503: 00000100:00100000:0.0:1787853473.110049:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853473.110097:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d1de540 going to sleep for 11 seconds 00000100:00100000:1.0:1787853473.112470:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152088064 00000100:00100000:1.0:1787853473.112484:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152088064 00000100:00100000:1.0:1787853473.112542:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787853473.112552:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:5821:x1874700152088064:12345-0@lo:503: 00000100:00100000:1.0:1787853473.113013:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:5821:x1874700152088064:12345-0@lo:503: Request processed in 461us (2962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853473.113020:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787853473.113417:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152088064:0@lo:503: 00000100:00100000:0.0:1787853473.116663:0:7119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7119:1874700152088192:0@lo:502: 00000100:00100000:0.0:1787853473.116939:0:7119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853473.117062:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152088192 00000100:00100000:0.0:1787853473.117062:0:7119:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d1de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853473.117070:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152088192 00000100:00100000:1.0:1787853473.117113:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787853473.117122:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:7119:x1874700152088192:12345-0@lo:502: 00000100:00100000:1.0:1787853473.117463:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:7119:x1874700152088192:12345-0@lo:502: Request processed in 341us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853473.117471:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787853473.117728:0:7119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7119:1874700152088192:0@lo:502: 00000100:00100000:0.0:1787853473.117855:0:7119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7119:1874700152088320:0@lo:502: 00000100:00100000:0.0:1787853473.117894:0:7119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853473.117922:0:7119:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d1de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853473.118186:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152088320 00000100:00100000:1.0:1787853473.118193:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152088320 00000100:00100000:1.0:1787853473.118222:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787853473.118229:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:7119:x1874700152088320:12345-0@lo:502: 00000100:00100000:1.0:1787853473.118413:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:7119:x1874700152088320:12345-0@lo:502: Request processed in 184us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853473.118419:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787853473.118558:0:7119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7119:1874700152088320:0@lo:502: 00000040:00080000:2.0:1787853473.118584:0:7119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787853473.119285:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787853473.119322:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787853473.119334:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff99275064d600/0xcf1365f7cb0546e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0546ea expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853473.119358:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff99275064d600/0xcf1365f7cb0546e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0546ea expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853473.119380:0:5821:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787853473.119383:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9927436b6000 from 4 10000000:01000000:3.0:1787853473.119385:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787853473.119420:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff99275064d200/0xcf1365f7cb0546f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853473.119427:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff99275064d200/0xcf1365f7cb0546f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853473.119436:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff99275064d200/0xcf1365f7cb0546f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853473.119557:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152088448:0@lo:101: 00000100:00100000:3.0:1787853473.119605:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853473.119708:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152088448 00000100:00100000:0.0:1787853473.119710:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927660f93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853473.119713:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152088448 00000100:00100000:1.0:1787853473.119753:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787853473.119762:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:5821:x1874700152088448:12345-0@lo:101: 00010000:00010000:1.0:1787853473.119774:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853473.119788:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927429f7400/0xcf1365f7cb0546f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0546f1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853473.119821:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927429f7400/0xcf1365f7cb0546f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0546f1 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853473.119832:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927429f7400/0xcf1365f7cb0546f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0546f1 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853473.119840:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927429f7400, rc 0) 00000100:00100000:1.0:1787853473.119882:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:5821:x1874700152088448:12345-0@lo:101: Request processed in 121us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853473.119889:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787853473.119929:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152088448:0@lo:101: 00010000:00010000:0.0:1787853473.119942:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff99275064d200/0xcf1365f7cb0546f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0546f8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853473.119962:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff99275064d200/0xcf1365f7cb0546f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0546f8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853473.120023:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152088576:0@lo:256: 00000100:00100000:0.0:1787853473.120066:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853473.120092:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d1de6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853473.120270:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152088576 00000100:00100000:2.0:1787853473.120275:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152088576 00000100:00100000:2.0:1787853473.120310:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787853473.120318:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:5821:x1874700152088576:12345-0@lo:256: 20000000:01000000:2.0:1787853473.120332:0:5819:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787853473.120349:0:5819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787853473.120356:0:5819:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787853473.120458:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:5821:x1874700152088576:12345-0@lo:256: Request processed in 140us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853473.120465:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787853473.120541:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152088576:0@lo:256: 10000000:01000000:1.0:1787853473.120581:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787853473.120587:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff99275064d200/0xcf1365f7cb0546f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0546f8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853473.120594:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff99275064d200/0xcf1365f7cb0546f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0546f8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853473.120601:0:5821:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787853473.120603:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787853473.120606:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787853473.120627:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb0546ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853473.120634:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb0546ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853473.120642:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb0546ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853473.120654:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152088704:0@lo:101: 00000100:00100000:1.0:1787853473.121067:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853473.121098:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277bf44600 going to sleep for 11 seconds 00000100:00100000:3.0:1787853473.121136:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152088704 00000100:00100000:3.0:1787853473.121141:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152088704 00000100:00100000:3.0:1787853473.121175:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787853473.121183:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:5821:x1874700152088704:12345-0@lo:101: 00010000:00010000:3.0:1787853473.121192:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853473.121202:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99275064ca00/0xcf1365f7cb054706 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0546ff expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853473.121219:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99275064ca00/0xcf1365f7cb054706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0546ff expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853473.121228:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99275064ca00/0xcf1365f7cb054706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0546ff expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853473.121236:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064ca00, rc 0) 00000100:00100000:3.0:1787853473.121286:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:5821:x1874700152088704:12345-0@lo:101: Request processed in 103us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853473.121292:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787853473.121416:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152088704:0@lo:101: 00010000:00010000:1.0:1787853473.121428:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb0546ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054706 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853473.121436:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb0546ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054706 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853473.121554:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152088832:0@lo:501: 00000100:00100000:1.0:1787853473.121578:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853473.121649:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277bf44600 going to sleep for 11 seconds 00000100:00100000:0.0:1787853473.122074:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152088832 00000100:00100000:0.0:1787853473.122079:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152088832 00000100:00100000:0.0:1787853473.122112:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787853473.122120:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992758772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:5821:x1874700152088832:12345-0@lo:501: 00000100:00100000:0.0:1787853473.122577:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992758772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:5821:x1874700152088832:12345-0@lo:501: Request processed in 456us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853473.122585:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787853473.122650:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152088832:0@lo:501: 00000100:00100000:0.0:1787853473.123243:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152088960:0@lo:503: 00000100:00100000:0.0:1787853473.123291:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853473.123366:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d1de6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853473.123512:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152088960 00000100:00100000:3.0:1787853473.123517:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152088960 00000100:00100000:3.0:1787853473.123558:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787853473.123566:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992758771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:5821:x1874700152088960:12345-0@lo:503: 00000100:00100000:3.0:1787853473.124185:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992758771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:5821:x1874700152088960:12345-0@lo:503: Request processed in 618us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853473.124193:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787853473.124260:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152088960:0@lo:503: 00000100:00100000:3.0:1787853473.124888:0:7120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761eaa1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7120:1874700152089088:0@lo:502: 00000100:00100000:3.0:1787853473.124945:0:7120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853473.125100:0:7120:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927660f9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787853473.125136:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152089088 00000100:00100000:0.0:1787853473.125142:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152089088 00000100:00100000:0.0:1787853473.125181:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787853473.125190:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:7120:x1874700152089088:12345-0@lo:502: 00000100:00100000:0.0:1787853473.125627:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:7120:x1874700152089088:12345-0@lo:502: Request processed in 437us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853473.125635:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787853473.125797:0:7120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761eaa1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7120:1874700152089088:0@lo:502: 00000020:01000000:3.0:1787853473.126427:0:7120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787853473.126434:0:7120:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787853473.128690:0:7120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853473.128697:0:7120:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787853473.128715:0:7120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787853473.128720:0:7120:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.110@tcp to nid 0x20000c0a8ce6e (192.168.206.110@tcp) 00000020:01000000:3.0:1787853473.128747:0:7120:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787853473.128750:0:7120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787853473.128769:0:7120:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9927500d99d0) 00000020:00000080:3.0:1787853473.128794:0:7120:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787853473.128812:0:7120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787853473.128910:0:7120:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787853473.128917:0:7120:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787853473.128944:0:7120:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf1365f7cb054714 00010000:00080000:3.0:1787853473.131131:0:7120:0:(ldlm_lib.c:102:import_set_conn()) imp ffff992747a35000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.110@tcp at head 00010000:00010000:0.0:1787853473.135192:0:7120:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787853473.178203:0:7120:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787853473.178227:0:7120:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787853473.178822:0:7120:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787853473.179013:0:7120:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787853473.179063:0:7120:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787853473.179129:0:7120:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787853473.179460:0:7125:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787853473.179465:0:7125:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787853473.182493:0:7120:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787853473.182508:0:7120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787853473.182548:0:7120:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787853473.182569:0:7120:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf1365f7cb05471b 00000100:00080000:0.0:1787853473.182579:0:7120:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787853473.182585:0:7120:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff992747a35000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:0.0:1787853473.182618:0:7120:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff992761ea7c00 x1874700152089216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787853473.182638:0:7120:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787853473.182712:0:7120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853473.182717:0:7120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853473.182719:0:7120:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787853473.182722:0:7120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853473.182726:0:7120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853473.182728:0:7120:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787853473.182731:0:7120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787853473.182733:0:7120:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787853473.182761:0:7120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7120:1874700152089344:0@lo:502: 00000100:00100000:0.0:1787853473.182853:0:7120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853473.182898:0:7120:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d1de3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853473.182924:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1874700152089216:0@lo:8: 00000100:00100000:0.0:1787853473.182957:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853473.183005:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152089344 00000100:00100000:0.0:1787853473.183011:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152089344 00000100:00100000:0.0:1787853473.183048:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787853473.183056:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:7120:x1874700152089344:12345-0@lo:502: 00000100:00100000:0.0:1787853473.183305:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:7120:x1874700152089344:12345-0@lo:502: Request processed in 249us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853473.183313:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787853473.183563:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152089216 00000100:00100000:0.0:1787853473.183568:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152089216 00000100:00100000:0.0:1787853473.183590:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787853473.183596:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3296:x1874700152089216:12345-0@lo:8: 00010000:00080000:0.0:1787853473.183614:0:6671:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:0.0:1787853473.183641:0:6671:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf1365f7cb054722 00002000:00100000:0.0:1787853473.183689:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9927441d8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113953 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787853473.183694:0:6671:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787853473.183698:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787853473.183805:0:6671:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1787853473.184117:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa28f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152089472:0@lo:400: 00000100:00100000:2.0:1787853473.184156:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853473.184196:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152089600:0@lo:400: 00000100:00100000:2.0:1787853473.184221:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853473.184255:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152089472 00000100:00100000:2.0:1787853473.184260:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152089472 00000100:00100000:2.0:1787853473.184288:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152089600 00000100:00100000:2.0:1787853473.184291:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152089600 00000100:00100000:2.0:1787853473.184316:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787853473.184323:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99275aa29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152089472:12345-0@lo:400: 00000100:00100000:2.0:1787853473.184363:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99275aa29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152089472:12345-0@lo:400: Request processed in 40us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853473.184370:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787853473.184396:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787853473.184402:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99275aa2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152089600:12345-0@lo:400: 00000100:00100000:2.0:1787853473.184432:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99275aa2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152089600:12345-0@lo:400: Request processed in 31us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853473.184438:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787853473.184463:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787853473.184488:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99275aa28f00 x1874700152089472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853473.184503:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa28f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152089472:0@lo:400: 00010000:00080000:2.0:1787853473.184550:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99275aa283c0 x1874700152089600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853473.184559:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152089600:0@lo:400: 00002000:00080000:0.0:1787853473.184594:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787853473.184618:0:6671:0:(import.c:65:import_set_state_nolock()) ffff9927441df800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853473.184659:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3296:x1874700152089216:12345-0@lo:8: Request processed in 1062us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853473.184689:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787853473.184723:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff992761ea7c00 x1874700152089216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787853483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853473.184733:0:3296:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787853473.184746:0:3296:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787853473.184887:0:3296:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787853473.184895:0:3296:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787853473.184898:0:3296:0:(import.c:65:import_set_state_nolock()) ffff992747a35000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787853473.184914:0:3296:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787853473.184920:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1874700152089216:0@lo:8: 00000100:00100000:0.0:1787853473.185031:0:7120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7120:1874700152089344:0@lo:502: 00000020:01000000:0.0:1787853473.185201:0:7120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853473.185207:0:7120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853473.185209:0:7120:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787853473.185215:0:7120:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1787853473.185333:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787853473.185915:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787853473.185926:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb0546ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054706 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853473.185939:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb0546ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054706 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853473.186198:0:5821:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787853473.186202:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99274364b3a0 from 1 10000000:01000000:0.0:1787853473.186205:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787853473.186237:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054729 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853473.186246:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054729 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853473.186255:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054729 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853473.186281:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152089728:0@lo:101: 00000100:00100000:0.0:1787853473.186332:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787853473.186349:0:7125:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787853473.186382:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992748f893c0 going to sleep for 11 seconds 00000004:00080000:2.0:1787853473.186459:0:7125:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 167483785634ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787853473.186530:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152089728 00000100:00100000:1.0:1787853473.186536:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152089728 00000100:00100000:1.0:1787853473.186576:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787853473.186585:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:5821:x1874700152089728:12345-0@lo:101: 00010000:00010000:1.0:1787853473.186597:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853473.186611:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb054730 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb054729 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853473.186635:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb054730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb054729 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853473.186646:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb054730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054729 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853473.186656:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927429f7c00, rc 0) 00000100:00100000:1.0:1787853473.186713:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:5821:x1874700152089728:12345-0@lo:101: Request processed in 129us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853473.186720:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787853473.187916:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152089728:0@lo:101: 00010000:00010000:0.0:1787853473.187936:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054729 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054730 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853473.187948:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054729 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054730 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853473.188039:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152089856:0@lo:501: 00000100:00100000:0.0:1787853473.188087:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853473.188127:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992748f893c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853473.188152:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152089856 00000100:00100000:2.0:1787853473.188158:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152089856 00000100:00100000:2.0:1787853473.188204:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787853473.188213:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:5821:x1874700152089856:12345-0@lo:501: 00000100:00100000:2.0:1787853473.188452:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:5821:x1874700152089856:12345-0@lo:501: Request processed in 239us (364us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787853473.188459:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787853473.189475:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152089856:0@lo:501: 10000000:01000000:0.0:1787853473.189506:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787853473.189513:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054729 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054730 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853473.189522:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054729 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054730 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787853473.243406:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787853473.246587:0:7126:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787853473.246620:0:7126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7126:1874700152090112:0@lo:7: 00000100:00100000:3.0:1787853473.246738:0:7126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853473.246789:0:7126:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927660f9780 going to sleep for 11 seconds 00000100:00100000:0.0:1787853473.246864:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152090112 00000100:00100000:0.0:1787853473.246882:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152090112 00000100:00100000:0.0:1787853473.246944:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787853473.246953:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761eaa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7126:x1874700152090112:12345-0@lo:7: 00000100:00080000:3.0:1787853473.247102:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853473.248012:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761eab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152089984:0@lo:13: 00000100:00100000:3.0:1787853473.249393:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853473.256545:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152089984 00000100:00100000:3.0:1787853473.256557:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152089984 00000100:00100000:3.0:1787853473.256643:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853473.256653:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1874700152089984:12345-0@lo:13: 00002000:00000024:3.0:1787853473.256704:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787853473.256776:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1874700152089984:12345-0@lo:13: Request processed in 124us (7388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853473.256783:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:0.0:1787853473.259115:0:6673:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787853473.259129:0:6673:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787853473.259224:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761eaa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7126:x1874700152090112:12345-0@lo:7: Request processed in 12268us (12482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853473.259234:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787853473.263515:0:7126:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff992761ea9a40 x1874700152090112/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787853489 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853473.263534:0:7126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7126:1874700152090112:0@lo:7: 00000004:00080000:3.0:1787853473.263549:0:7126:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787853473.263595:0:7126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7126:1874700152090240:0@lo:5: 00000100:00100000:3.0:1787853473.263655:0:7126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787853473.269124:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff992761eab0c0 x1874700152089984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853473.269157:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761eab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152089984:0@lo:13: 00000100:00100000:2.0:1787853473.271242:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152090240 00000100:00100000:2.0:1787853473.271255:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152090240 00000100:00100000:2.0:1787853473.271432:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787853473.271443:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7126:x1874700152090240:12345-0@lo:5: 00002000:00080000:2.0:1787853473.271473:0:6672:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787853473.271477:0:6672:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787853473.271864:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7126:x1874700152090240:12345-0@lo:5: Request processed in 423us (8208us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787853473.272033:0:7126:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927660f9780 going to sleep for 11 seconds 00010000:00080000:3.0:1787853473.272059:0:7126:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff992761ea9a40 x1874700152090240/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787853489 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853473.272074:0:7126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7126:1874700152090240:0@lo:5: 00000004:00080000:3.0:1787853473.272085:0:7126:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787853473.272130:0:7126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7126:1874700152090368:0@lo:700: 00000100:00100000:3.0:1787853473.272186:0:7126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853473.272208:0:7126:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927660f9780 going to sleep for 11 seconds 00000100:00100000:2.0:1787853473.273058:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787853473.273126:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152090368 00000100:00100000:2.0:1787853473.273137:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152090368 00000100:00100000:2.0:1787853473.273187:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787853473.273195:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761eab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7126:x1874700152090368:12345-0@lo:700: 00000100:00100000:2.0:1787853473.273245:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa283c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6679:1874700152090496:0@lo:700: 00000100:00100000:2.0:1787853473.273285:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853473.273316:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff992766057b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787853473.273404:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152090496 00000100:00100000:3.0:1787853473.273409:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152090496 00000100:00100000:3.0:1787853473.273440:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853473.273447:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99275aa28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6679:x1874700152090496:12345-0@lo:700: 40000000:02000000:0.0:1787853473.309315:0:5831:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787853473.320593:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99275aa28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6679:x1874700152090496:12345-0@lo:700: Request processed in 47138us (47299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853473.320614:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787853473.320616:0:6679:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99275aa283c0 x1874700152090496/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787853489 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853473.320632:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa283c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6679:1874700152090496:0@lo:700: 40000000:02000000:2.0:1787853473.320645:0:6679:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:0.0:1787853473.442735:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787853473.442754:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:1.0:1787853473.442934:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761eab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7126:x1874700152090368:12345-0@lo:700: Request processed in 169735us (170742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853473.442955:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787853473.443132:0:7126:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff992761ea8b40 x1874700152090368/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787853489 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853473.443144:0:7126:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787853473.443162:0:7126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7126:1874700152090368:0@lo:700: 00000004:02000040:0.0:1787853473.537092:0:7126:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1787853473.542547:0:7126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7126:1874700152090624:0@lo:5: 00000100:00100000:1.0:1787853473.542623:0:7126:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853473.542800:0:7126:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277bf44240 going to sleep for 11 seconds 00000100:00100000:0.0:1787853473.544134:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152090624 00000100:00100000:0.0:1787853473.544146:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152090624 00000100:00100000:0.0:1787853473.544203:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787853473.544212:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7126:x1874700152090624:12345-0@lo:5: 00002000:00080000:2.0:1787853473.558235:0:6673:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787853473.558260:0:6673:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1787853473.568284:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7126:x1874700152090624:12345-0@lo:5: Request processed in 24067us (25654us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787853473.568300:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787853473.568569:0:7126:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff992761e68780 x1874700152090624/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787853489 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853473.568593:0:7126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7126:1874700152090624:0@lo:5: 00000004:00080000:2.0:1787853473.568609:0:7126:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787853473.669853:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853474.697303:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853475.718122:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787853476.432352:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787853476.745943:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853477.768556:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853478.214238:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152090880:0@lo:400: 00000100:00100000:3.0:1787853478.216602:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152090752:0@lo:400: 00000100:00100000:3.0:1787853478.216733:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853478.216835:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152091008:0@lo:400: 00000100:00100000:3.0:1787853478.216898:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853478.216921:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787853478.216927:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152091136:0@lo:400: 00000100:00100000:3.0:1787853478.216970:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853478.217010:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152091008 00000100:00100000:3.0:1787853478.217018:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152091008 00000100:00100000:3.0:1787853478.217070:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787853478.217079:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761eaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152091008:12345-0@lo:400: 00000100:00100000:3.0:1787853478.217125:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761eaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152091008:12345-0@lo:400: Request processed in 48us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853478.217133:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787853478.217155:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787853478.217177:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99275aa2b0c0 x1874700152091008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853478.217190:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152091008:0@lo:400: 00000100:00100000:3.0:1787853478.217221:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152091136 00000100:00100000:3.0:1787853478.217236:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152091136 00000100:00100000:3.0:1787853478.217275:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853478.217282:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152091136:12345-0@lo:400: 00000100:00100000:3.0:1787853478.217315:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152091136:12345-0@lo:400: Request processed in 34us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853478.217321:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787853478.217334:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787853478.217349:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99275aa2a580 x1874700152091136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853478.217357:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787853478.217367:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152091136:0@lo:400: 00000100:00100000:2.0:1787853478.223818:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853478.224476:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152090752 00000100:00100000:0.0:1787853478.224485:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152090752 00000100:00100000:0.0:1787853478.224533:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787853478.224542:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:3297:x1874700152090752:12345-0@lo:400: 00000100:00100000:0.0:1787853478.224613:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:3297:x1874700152090752:12345-0@lo:400: Request processed in 72us (7880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853478.224620:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787853478.224699:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152090752:0@lo:400: 00000100:00100000:3.0:1787853478.227121:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152090880 00000100:00100000:3.0:1787853478.227134:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152090880 00000100:00100000:3.0:1787853478.227199:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787853478.227209:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99275aa28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152090880:12345-0@lo:400: 00000100:00100000:3.0:1787853478.227298:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99275aa28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152090880:12345-0@lo:400: Request processed in 91us (3486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853478.227306:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787853478.231093:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99275aa2b840 x1874700152090880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853478.231111:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152090880:0@lo:400: 00000100:00100000:2.0:1787853478.726028:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152091264:0@lo:13: 00000100:00100000:2.0:1787853478.726126:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853478.729248:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152091264 00000100:00100000:1.0:1787853478.729267:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152091264 00000100:00100000:1.0:1787853478.729358:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787853478.729368:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99275aa2b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152091264:12345-0@lo:13: 00002000:00000024:1.0:1787853478.729401:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853478.729482:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99275aa2b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152091264:12345-0@lo:13: Request processed in 116us (3356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853478.729490:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787853478.732146:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff992761e68780 x1874700152091264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853478.732173:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152091264:0@lo:13: 00010000:00010000:0.0:1787853478.791632:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853479.818489:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853480.838240:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853481.862620:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853482.888040:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853483.335206:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152091392:0@lo:400: 00000100:00100000:2.0:1787853483.335275:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853483.335329:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787853483.335336:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927754812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152091776:0@lo:400: 00000100:00100000:2.0:1787853483.335362:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853483.335395:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152091520:0@lo:400: 00000100:00100000:2.0:1787853483.335421:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853483.335440:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787853483.335445:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152091648:0@lo:400: 00000100:00100000:2.0:1787853483.335463:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853483.335488:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152091392 00000100:00100000:2.0:1787853483.335494:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152091392 00000100:00100000:2.0:1787853483.335528:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787853483.335546:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:3298:x1874700152091392:12345-0@lo:400: 00000100:00100000:2.0:1787853483.335587:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:3298:x1874700152091392:12345-0@lo:400: Request processed in 52us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853483.335593:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787853483.335619:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152091520 00000100:00100000:2.0:1787853483.335622:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152091520 00000100:00100000:2.0:1787853483.335641:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152091648 00000100:00100000:2.0:1787853483.335643:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152091648 00000100:00100000:2.0:1787853483.335662:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787853483.335667:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775482580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152091520:12345-0@lo:400: 00000100:00100000:2.0:1787853483.335718:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775482580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152091520:12345-0@lo:400: Request processed in 49us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853483.335731:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787853483.335745:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787853483.335751:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927754821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152091648:12345-0@lo:400: 00000100:00100000:2.0:1787853483.335780:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927754821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152091648:12345-0@lo:400: Request processed in 30us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853483.335786:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787853483.335808:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787853483.335831:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99275aa2b0c0 x1874700152091648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853483.335844:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152091648:0@lo:400: 00010000:00080000:2.0:1787853483.335853:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99275aa2a580 x1874700152091520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853483.335861:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152091520:0@lo:400: 00000100:00100000:2.0:1787853483.335885:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152091392:0@lo:400: 00000100:00100000:1.0:1787853483.337977:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152091776 00000100:00100000:1.0:1787853483.337989:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152091776 00000100:00100000:1.0:1787853483.338044:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787853483.338052:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775480b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152091776:12345-0@lo:400: 00000100:00100000:1.0:1787853483.338122:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775480b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152091776:12345-0@lo:400: Request processed in 71us (2758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853483.338128:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787853483.339711:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787853483.339761:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9927754812c0 x1874700152091776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853483.339777:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927754812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152091776:0@lo:400: 00000020:01000004:2.0:1787853483.810932:0:7602:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787853483.810936:0:7602:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787853483.811076:0:7602:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9927441ba000 00000020:01000004:2.0:1787853483.811092:0:7602:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787853483.811104:0:7602:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787853483.811123:0:7602:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9927756e99d0) 00000020:00000080:2.0:1787853483.811140:0:7602:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787853483.834560:0:7602:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787853483.834830:0:7602:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00000100:00100000:0.0:1787853483.846085:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152091904:0@lo:13: 00000100:00100000:0.0:1787853483.846153:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853483.846265:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152091904 00000100:00100000:1.0:1787853483.846273:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152091904 00000100:00100000:1.0:1787853483.846321:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787853483.846330:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152091904:12345-0@lo:13: 00002000:00000024:1.0:1787853483.846357:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853483.846418:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152091904:12345-0@lo:13: Request processed in 88us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853483.846425:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787853483.846463:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff992761e6b0c0 x1874700152091904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853483.846480:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152091904:0@lo:13: 00100000:10000000:1.0:1787853483.874398:0:7602:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787853483.885399:0:7602:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787853483.885444:0:7602:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787853483.885502:0:7602:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787853483.885528:0:7602:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787853483.885862:0:7602:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787853483.885874:0:7602:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787853483.885883:0:7602:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf1365f7cb05473e 00000020:01000004:1.0:1787853483.885890:0:7602:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1787853483.885920:0:7602:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.110@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787853483.885924:0:7602:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787853483.885929:0:7602:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787853483.885958:0:7602:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1787853483.885962:0:7602:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.110@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:2.0:1787853483.912720:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787853483.914754:0:7602:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787853483.914785:0:7602:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.110@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787853483.914789:0:7602:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787853483.914791:0:7602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787853483.914792:0:7602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787853483.914793:0:7602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787853483.914795:0:7602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787853483.914796:0:7602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787853483.914798:0:7602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787853483.914799:0:7602:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787853483.914801:0:7602:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787853483.914803:0:7602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787853483.914804:0:7602:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787853483.914808:0:7602:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787853483.914810:0:7602:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787853483.914811:0:7602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787853483.914812:0:7602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787853483.914814:0:7602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787853483.914815:0:7602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787853483.914817:0:7602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787853483.914818:0:7602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787853483.914819:0:7602:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787853483.914820:0:7602:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787853483.914821:0:7602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787853483.914827:0:7602:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787853483.914850:0:7602:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787853483.914866:0:7602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152092032:0@lo:253: 00000100:00100000:0.0:1787853483.915061:0:7602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853483.915174:0:7602:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927601d3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853483.915245:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152092032 00000100:00100000:2.0:1787853483.915251:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152092032 00000100:00100000:2.0:1787853483.915325:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787853483.915335:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:7602:x1874700152092032:12345-0@lo:253: 20000000:01000000:2.0:1787853483.915363:0:5819:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787853483.915368:0:5819:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1787853483.915373:0:5819:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1787853483.915376:0:5819:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1787853483.916611:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787853483.916850:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1787853483.916863:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1787853483.916903:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1787853483.916921:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1787853483.916967:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1787853483.917017:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1787853483.917354:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1787853483.917372:0:5819:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.110@tcp 20000000:01000000:2.0:1787853483.917374:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.110@tcp (null) (null) (null) 00000040:00080000:2.0:1787853483.917405:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1787853483.917413:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787853483.917467:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1787853483.917476:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.110@tcp (null) (null) 00000040:00080000:2.0:1787853483.917509:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1787853483.917518:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787853483.917547:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1787853483.917596:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1787853483.918337:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1787853483.919371:0:5819:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.110@tcp 20000000:01000000:2.0:1787853483.919374:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.110@tcp (null) (null) (null) 00000040:00080000:2.0:1787853483.919502:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1787853483.919520:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787853483.919558:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1787853483.919567:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.110@tcp (null) (null) 00000040:00080000:2.0:1787853483.919597:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1787853483.919605:0:5819:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787853483.919875:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1787853483.920262:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1787853483.920285:0:5819:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787853483.920288:0:5819:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787853483.920293:0:5819:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787853483.920307:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787853483.920310:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787853483.920351:0:5819:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787853483.920354:0:5819:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787853483.921338:0:7604:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787853483.921482:0:7604:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787853483.921544:0:7604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787853483.922254:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1787853483.922297:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1787853483.922351:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1787853483.922364:0:5819:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787853483.922366:0:5819:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787853483.923348:0:7605:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1787853483.923516:0:7605:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1787853483.923556:0:7605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1787853483.924310:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1787853483.924358:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1787853483.924497:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1787853483.924510:0:5819:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787853483.924513:0:5819:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787853483.925397:0:7606:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1787853483.925528:0:7606:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1787853483.925589:0:7606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787853483.926215:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787853483.926256:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787853483.926318:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787853483.926330:0:5819:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787853483.926332:0:5819:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787853483.927130:0:7607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787853483.927361:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787853483.927397:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787853483.927549:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1787853483.927566:0:5819:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787853483.927573:0:5819:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787853483.927581:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787853483.927598:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff992747f71a00/0xcf1365f7cb054745 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.927615:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9927429f7a00/0xcf1365f7cb054696 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05468f expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.927623:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff992747f70400/0xcf1365f7cb0546c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0546b9 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.927631:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff992740031800/0xcf1365f7cb0546ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0546e3 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.927637:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99275064ca00/0xcf1365f7cb054706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0546ff expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.927645:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb054730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054729 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.927653:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff992747f71a00/0xcf1365f7cb054745 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.927792:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb054730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb054729 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.927807:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb054730 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb054729 expref: 16 pid: 5816 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853483.927821:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927754812c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5819:1874700152092160:0@lo:104: 00000100:00100000:2.0:1787853483.927877:0:5819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787853483.928146:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99275064ca00/0xcf1365f7cb054706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb0546ff expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.928161:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99275064ca00/0xcf1365f7cb054706 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb0546ff expref: 16 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853483.928171:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927754830c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5819:1874700152092288:0@lo:104: 00010000:00010000:2.0:1787853483.928198:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff992740031800/0xcf1365f7cb0546ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb0546e3 expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.928205:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff992740031800/0xcf1365f7cb0546ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb0546e3 expref: 16 pid: 5819 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853483.928214:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992775483840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5819:1874700152092416:0@lo:104: 00010000:00010000:2.0:1787853483.928242:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff992747f70400/0xcf1365f7cb0546c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb0546b9 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.928251:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff992747f70400/0xcf1365f7cb0546c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb0546b9 expref: 16 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853483.928259:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992775481680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5819:1874700152092544:0@lo:104: 00010000:00010000:2.0:1787853483.928282:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9927429f7a00/0xcf1365f7cb054696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb05468f expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.928290:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9927429f7a00/0xcf1365f7cb054696 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb05468f expref: 16 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853483.928298:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992775482d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5819:1874700152092672:0@lo:104: 00000100:00100000:2.0:1787853483.928312:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff992748eb8000 going to sleep for 11 seconds 00000100:00100000:0.0:1787853483.928367:0:5808:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787853483.928385:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853483.928501:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853483.928565:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853483.928583:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152092160 00000100:00100000:1.0:1787853483.928589:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152092160 00000100:00100000:1.0:1787853483.928617:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152092288 00000100:00100000:1.0:1787853483.928620:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152092288 00000100:00100000:1.0:1787853483.928627:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152092416 00000100:00100000:1.0:1787853483.928629:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152092416 00000100:00100000:1.0:1787853483.928640:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787853483.928648:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992766162050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+5:5819:x1874700152092160:12345-0@lo:104: 00010000:00010000:1.0:1787853483.928665:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054729 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054730 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853483.928748:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787853483.928753:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992766162050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+5:5819:x1874700152092160:12345-0@lo:104: Request processed in 106us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853483.928760:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787853483.928801:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787853483.928808:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+4:5819:x1874700152092288:12345-0@lo:104: 00010000:00010000:1.0:1787853483.928815:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb0546ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054706 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853483.928843:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787853483.928847:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+4:5819:x1874700152092288:12345-0@lo:104: Request processed in 41us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853483.928853:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787853483.928864:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787853483.928869:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:5819:x1874700152092416:12345-0@lo:104: 00010000:00010000:1.0:1787853483.928876:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff99275064d600/0xcf1365f7cb0546e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0546ea expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853483.928898:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787853483.928903:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:5819:x1874700152092416:12345-0@lo:104: Request processed in 35us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853483.928922:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1787853483.929109:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787853483.929116:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054729 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054730 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.929123:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031400 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1787853483.929126:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054729 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb054730 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.929143:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb054730 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853483.929151:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb054730 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853483.929157:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787853483.929180:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054729 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054730 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.929185:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787853483.929197:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054729 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054730 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.929203:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff992740031400/0xcf1365f7cb054729 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054730 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.929215:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787853483.929217:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb0546ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054706 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.929222:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927429f6200 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1787853483.929224:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb0546ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb054706 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.929230:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb0546ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb054706 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853483.929235:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb0546ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb054706 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853483.929245:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787853483.929256:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb0546ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054706 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.929261:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787853483.929265:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb0546ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054706 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.929271:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb0546ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054706 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.929279:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853483.929281:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff99275064d600/0xcf1365f7cb0546e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0546ea expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.929285:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d600 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1787853483.929288:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff99275064d600/0xcf1365f7cb0546e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb0546ea expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.929294:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff99275064d600/0xcf1365f7cb0546e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb0546ea expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853483.929299:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff99275064d600/0xcf1365f7cb0546e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb0546ea expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853483.929303:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787853483.929310:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff99275064d600/0xcf1365f7cb0546e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0546ea expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.929314:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787853483.929333:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff99275064d600/0xcf1365f7cb0546e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0546ea expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.929339:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff99275064d600/0xcf1365f7cb0546e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0546ea expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.929348:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853483.929350:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853483.929352:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853483.929358:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787853483.929369:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152093056:0@lo:103: 00000100:00100000:3.0:1787853483.929397:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853483.929622:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152093056 00000100:00100000:1.0:1787853483.929628:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152093056 00010000:00010000:1.0:1787853483.929648:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff992740031800/0xcf1365f7cb0546ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0546e3 expref: 17 pid: 5819 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853483.929703:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787853483.929711:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761eabc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:3298:x1874700152093056:12345-0@lo:103: 00010000:00010000:1.0:1787853483.929720:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853483.929725:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff992740031800/0xcf1365f7cb0546ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0546e3 expref: 17 pid: 5819 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853483.929733:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff992740031800/0xcf1365f7cb0546ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb0546e3 expref: 17 pid: 5819 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853483.929748:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853483.929775:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761eabc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:3298:x1874700152093056:12345-0@lo:103: Request processed in 66us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853483.929782:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787853483.929856:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152092800:0@lo:103: 00000100:00100000:2.0:1787853483.929888:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853483.929937:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787853483.929943:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761eab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152092928:0@lo:103: 00000100:00100000:1.0:1787853483.930037:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152092800 00000100:00100000:1.0:1787853483.930041:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152092800 00010000:00010000:1.0:1787853483.930055:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb054730 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb054729 expref: 17 pid: 5816 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853483.930085:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787853483.930092:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775481e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:3299:x1874700152092800:12345-0@lo:103: 00010000:00010000:1.0:1787853483.930099:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853483.930103:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb054730 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb054729 expref: 17 pid: 5816 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853483.930113:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb054730 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb054729 expref: 17 pid: 5816 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853483.930123:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853483.930150:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775481e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:3299:x1874700152092800:12345-0@lo:103: Request processed in 59us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853483.930156:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787853483.930285:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853483.930322:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152092800:0@lo:103: 00010000:00010000:2.0:1787853483.930355:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853483.930371:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb054730 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb054729 expref: 16 pid: 5816 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853483.930381:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927754812c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5819:1874700152092160:0@lo:104: 00000100:00100000:2.0:1787853483.930389:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927754830c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5819:1874700152092288:0@lo:104: 00010000:00010000:2.0:1787853483.930397:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992740031800/0xcf1365f7cb0546ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb0546e3 expref: 15 pid: 5819 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853483.930416:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992775483840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5819:1874700152092416:0@lo:104: 00000100:00100000:3.0:1787853483.930518:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152092928 00000100:00100000:3.0:1787853483.930523:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152092928 00010000:00010000:3.0:1787853483.930541:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99275064ca00/0xcf1365f7cb054706 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0546ff expref: 15 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853483.930571:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787853483.930578:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775480780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:3299:x1874700152092928:12345-0@lo:103: 00010000:00010000:3.0:1787853483.930587:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853483.930591:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99275064ca00/0xcf1365f7cb054706 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0546ff expref: 15 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.930599:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99275064ca00/0xcf1365f7cb054706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb0546ff expref: 15 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.930608:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99275064ca00/0xcf1365f7cb054706 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb0546ff expref: 15 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.930618:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853483.930652:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775480780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:3299:x1874700152092928:12345-0@lo:103: Request processed in 75us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853483.930658:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787853483.930704:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152093056:0@lo:103: 00000100:00100000:2.0:1787853483.930815:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761eab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152092928:0@lo:103: 00000100:00100000:0.0:1787853483.933227:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853483.933244:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152092544 00000100:00100000:0.0:1787853483.933251:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152092544 00000100:00100000:0.0:1787853483.933290:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152092672 00000100:00100000:0.0:1787853483.933293:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152092672 00000100:00100000:0.0:1787853483.933306:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787853483.933313:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+4:5819:x1874700152092544:12345-0@lo:104: 00010000:00010000:0.0:1787853483.933328:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb0546b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0546c0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.933721:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853483.933730:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb0546b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0546c0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.933739:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740030600 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1787853483.933743:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb0546b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb0546c0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.933752:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb0546b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb0546c0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853483.933759:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb0546b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb0546c0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853483.933765:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787853483.933799:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb0546b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0546c0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.933805:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787853483.933821:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb0546b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0546c0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.933828:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb0546b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0546c0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.933843:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853483.933855:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853483.933857:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853483.933873:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152093184:0@lo:103: 00000100:00100000:3.0:1787853483.933927:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853483.934152:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152093184 00000100:00100000:3.0:1787853483.934157:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152093184 00010000:00010000:3.0:1787853483.934177:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff992747f70400/0xcf1365f7cb0546c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0546b9 expref: 14 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853483.934200:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787853483.934206:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:3298:x1874700152093184:12345-0@lo:103: 00010000:00010000:3.0:1787853483.934215:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853483.934220:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff992747f70400/0xcf1365f7cb0546c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0546b9 expref: 14 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.934229:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff992747f70400/0xcf1365f7cb0546c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb0546b9 expref: 14 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.934246:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853483.934272:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:3298:x1874700152093184:12345-0@lo:103: Request processed in 67us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853483.934279:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787853483.934312:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152093184:0@lo:103: 00010000:00010000:3.0:1787853483.934340:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992747f70400/0xcf1365f7cb0546c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb0546b9 expref: 13 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853483.934350:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992775481680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5819:1874700152092544:0@lo:104: 00010000:00010000:0.0:1787853483.934510:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787853483.934518:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+4:5819:x1874700152092544:12345-0@lo:104: Request processed in 1205us (5952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853483.934524:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787853483.934540:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787853483.934546:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:5819:x1874700152092672:12345-0@lo:104: 00010000:00010000:0.0:1787853483.934554:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb05468f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054696 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853483.934598:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787853483.934602:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:5819:x1874700152092672:12345-0@lo:104: Request processed in 58us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853483.934614:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787853483.934716:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853483.934722:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb05468f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054696 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.934729:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064ce00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1787853483.934732:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb05468f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb054696 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.934738:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb05468f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb054696 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853483.934758:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb05468f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb054696 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853483.934763:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787853483.934784:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb05468f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054696 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.934789:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853483.934803:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb05468f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054696 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.934810:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb05468f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054696 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.934824:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853483.934825:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853483.934827:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853483.934833:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787853483.934842:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992775482940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152093312:0@lo:103: 00000100:00100000:2.0:1787853483.934867:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853483.934893:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152093312 00000100:00100000:2.0:1787853483.934897:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152093312 00010000:00010000:2.0:1787853483.934930:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9927429f7a00/0xcf1365f7cb054696 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb05468f expref: 13 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853483.934951:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787853483.934958:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775481a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:3300:x1874700152093312:12345-0@lo:103: 00010000:00010000:2.0:1787853483.935139:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853483.935144:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9927429f7a00/0xcf1365f7cb054696 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb05468f expref: 13 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.935159:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9927429f7a00/0xcf1365f7cb054696 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb05468f expref: 13 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.935171:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff992747f71a00/0xcf1365f7cb054745 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.935179:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992747f71a00/0xcf1365f7cb054745 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.935191:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff992747f71a00/0xcf1365f7cb054745 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.935198:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff992747f71a00/0xcf1365f7cb054745 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.935204:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff992747f71a00/0xcf1365f7cb054745 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.935210:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff992747f71a00/0xcf1365f7cb054745 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.935215:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71a00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853483.935218:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff992747f71a00/0xcf1365f7cb054745 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.935225:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff992747f71a00/0xcf1365f7cb054745 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.935232:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff992747f71a00/0xcf1365f7cb054745 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853483.935248:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853483.935277:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775481a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:3300:x1874700152093312:12345-0@lo:103: Request processed in 319us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853483.935283:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787853483.935308:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992775482940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152093312:0@lo:103: 00010000:00010000:3.0:1787853483.935384:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927429f7a00/0xcf1365f7cb054696 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb05468f expref: 12 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853483.935413:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992775482d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5819:1874700152092672:0@lo:104: 00010000:00010000:3.0:1787853483.935542:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff992747f71a00/0xcf1365f7cb054745 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.935552:0:5819:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff992747f71a00/0xcf1365f7cb054745 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.935558:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff992747f71a00/0xcf1365f7cb054745 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853483.935564:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992747f71a00/0xcf1365f7cb054745 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787853483.935576:0:5819:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787853484.004943:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:7602:x1874700152092032:12345-0@lo:253: Request processed in 89602us (89875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853484.004958:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787853484.005341:0:7602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152092032:0@lo:253: 10000000:01000000:1.0:1787853484.005356:0:7602:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787853484.005359:0:7602:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787853484.005361:0:7602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787853484.005362:0:7602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853484.005364:0:7602:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787853484.005365:0:7602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853484.005366:0:7602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853484.005368:0:7602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787853484.005370:0:7602:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787853484.005371:0:7602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853484.005373:0:7602:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787853484.005390:0:7602:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9927441ba000 from lustre-OST0001 10000000:01000000:1.0:1787853484.005411:0:7602:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787853484.005414:0:7602:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787853484.005420:0:7602:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99274364b3a0 local copy 10000000:01000000:1.0:1787853484.005424:0:7602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787853484.005454:0:7602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb05474c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853484.005464:0:7602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb05474c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853484.005472:0:7602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb05474c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853484.005489:0:7602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152093440:0@lo:101: 00000100:00100000:1.0:1787853484.005521:0:7602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853484.005667:0:7602:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d550c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853484.007226:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152093440 00000100:00100000:2.0:1787853484.007236:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152093440 00000100:00100000:2.0:1787853484.007331:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787853484.007340:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:7602:x1874700152093440:12345-0@lo:101: 00010000:00010000:2.0:1787853484.007353:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853484.007368:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992747f71c00/0xcf1365f7cb054753 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb05474c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.007390:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992747f71c00/0xcf1365f7cb054753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb05474c expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.007401:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992747f71c00/0xcf1365f7cb054753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05474c expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.007410:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71c00, rc 0) 00000100:00100000:2.0:1787853484.007614:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:7602:x1874700152093440:12345-0@lo:101: Request processed in 274us (2090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853484.007620:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787853484.007704:0:7602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152093440:0@lo:101: 00010000:00010000:1.0:1787853484.007732:0:7602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb05474c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcf1365f7cb054753 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853484.007742:0:7602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb05474c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf1365f7cb054753 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853484.007854:0:7602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152093568:0@lo:501: 00000100:00100000:1.0:1787853484.007884:0:7602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853484.015353:0:7602:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d550c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853484.015406:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152093568 00000100:00100000:2.0:1787853484.015433:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152093568 00000100:00100000:2.0:1787853484.015536:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787853484.015546:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:7602:x1874700152093568:12345-0@lo:501: 00000100:00100000:2.0:1787853484.015814:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:7602:x1874700152093568:12345-0@lo:501: Request processed in 268us (7927us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787853484.015822:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787853484.016321:0:7602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152093568:0@lo:501: 10000000:01000000:1.0:1787853484.016346:0:7602:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787853484.016384:0:7602:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787853484.016392:0:7602:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb05474c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf1365f7cb054753 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853484.016403:0:7602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb05474c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf1365f7cb054753 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853484.016410:0:7602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb05474c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf1365f7cb054753 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853484.016435:0:7602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787853484.016460:0:7602:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9927441ba000 10000000:01000000:1.0:1787853484.016465:0:7602:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787853484.016470:0:7602:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787853484.016473:0:7602:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787853484.016477:0:7602:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787853484.016480:0:7602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787853484.016512:0:7602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f7000/0xcf1365f7cb05475a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853484.016520:0:7602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9927429f7000/0xcf1365f7cb05475a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853484.016528:0:7602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927429f7000/0xcf1365f7cb05475a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853484.016545:0:7602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152093696:0@lo:101: 00000100:00100000:1.0:1787853484.016579:0:7602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787853484.016705:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853484.016712:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb05474c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcf1365f7cb054753 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853484.016718:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927429f6c00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1787853484.016721:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb05474c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcf1365f7cb054753 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853484.016728:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb05474c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcf1365f7cb054753 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853484.016734:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb05474c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcf1365f7cb054753 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853484.016739:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787853484.016766:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb05474c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf1365f7cb054753 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853484.016772:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787853484.016792:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb05474c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf1365f7cb054753 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853484.016799:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb05474c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf1365f7cb054753 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853484.016812:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853484.016814:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853484.016816:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853484.016828:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152093824:0@lo:103: 00000100:00100000:3.0:1787853484.016856:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853484.016899:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152093824 00000100:00100000:3.0:1787853484.016904:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152093824 00000100:00100000:3.0:1787853484.016956:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787853484.016963:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761eab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:3300:x1874700152093824:12345-0@lo:103: 00010000:00010000:3.0:1787853484.016985:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853484.016999:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992747f71c00/0xcf1365f7cb054753 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf1365f7cb05474c expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853484.017011:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853484.017040:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761eab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:3300:x1874700152093824:12345-0@lo:103: Request processed in 78us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853484.017046:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787853484.017095:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152093824:0@lo:103: 00000100:00100000:1.0:1787853484.017545:0:7602:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d550600 going to sleep for 11 seconds 00000100:00100000:2.0:1787853484.017661:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152093696 00000100:00100000:2.0:1787853484.017665:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152093696 00000100:00100000:2.0:1787853484.017701:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787853484.017708:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+11:7602:x1874700152093696:12345-0@lo:101: 00010000:00010000:2.0:1787853484.017718:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853484.017729:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992747f71400/0xcf1365f7cb054761 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb05475a expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.017748:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992747f71400/0xcf1365f7cb054761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb05475a expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.017758:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992747f71400/0xcf1365f7cb054761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05475a expref: 12 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.017765:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71400, rc 0) 00000100:00100000:2.0:1787853484.017796:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:7602:x1874700152093696:12345-0@lo:101: Request processed in 89us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853484.017802:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787853484.017878:0:7602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152093696:0@lo:101: 00010000:00010000:1.0:1787853484.017891:0:7602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927429f7000/0xcf1365f7cb05475a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054761 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853484.017901:0:7602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927429f7000/0xcf1365f7cb05475a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054761 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853484.018008:0:7602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152093952:0@lo:501: 00000100:00100000:1.0:1787853484.018035:0:7602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853484.018250:0:7602:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d550600 going to sleep for 11 seconds 00000100:00100000:0.0:1787853484.018441:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152093952 00000100:00100000:0.0:1787853484.018447:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152093952 00000100:00100000:3.0:1787853484.018635:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787853484.018697:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:7602:x1874700152093952:12345-0@lo:501: 00000100:00100000:3.0:1787853484.018935:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:7602:x1874700152093952:12345-0@lo:501: Request processed in 241us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853484.019583:0:7602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152093952:0@lo:501: 00000100:00100000:1.0:1787853484.021887:0:7602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152094080:0@lo:503: 00000100:00100000:1.0:1787853484.022325:0:7602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853484.022363:0:7602:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d550600 going to sleep for 11 seconds 00000100:00100000:0.0:1787853484.022524:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152094080 00000100:00100000:0.0:1787853484.022531:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152094080 00000100:00100000:3.0:1787853484.023290:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787853484.023335:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787853484.023345:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:7602:x1874700152094080:12345-0@lo:503: 00000100:00100000:3.0:1787853484.023652:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:7602:x1874700152094080:12345-0@lo:503: Request processed in 308us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853484.023659:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787853484.023758:0:7602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152094080:0@lo:503: 00000040:00080000:1.0:1787853484.024330:0:7602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787853484.024398:0:7602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152094208:0@lo:502: 00000100:00100000:1.0:1787853484.024456:0:7602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853484.024491:0:7602:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d550600 going to sleep for 11 seconds 00000100:00100000:2.0:1787853484.024550:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152094208 00000100:00100000:2.0:1787853484.024555:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152094208 00000100:00100000:2.0:1787853484.024580:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787853484.024587:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:7602:x1874700152094208:12345-0@lo:502: 00000100:00100000:2.0:1787853484.024751:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:7602:x1874700152094208:12345-0@lo:502: Request processed in 163us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853484.024762:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787853484.025009:0:7602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152094208:0@lo:502: 00000040:00080000:1.0:1787853484.025461:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787853484.025514:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787853484.025550:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787853484.025600:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787853484.025635:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787853484.025666:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787853484.025730:0:7602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152094336:0@lo:502: 00000100:00100000:1.0:1787853484.025774:0:7602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853484.025796:0:7602:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d550600 going to sleep for 11 seconds 00000100:00100000:2.0:1787853484.025860:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152094336 00000100:00100000:2.0:1787853484.025865:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152094336 00000100:00100000:2.0:1787853484.025886:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787853484.025892:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:7602:x1874700152094336:12345-0@lo:502: 00000100:00100000:2.0:1787853484.026066:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:7602:x1874700152094336:12345-0@lo:502: Request processed in 172us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853484.026080:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787853484.026522:0:7602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152094336:0@lo:502: 00000040:00080000:1.0:1787853484.026608:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787853484.026618:0:7602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787853484.027565:0:7610:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787853484.027573:0:7610:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787853484.027579:0:7610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853484.027581:0:7610:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787853484.027586:0:7610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787853484.027599:0:7610:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99276e8219d0) 00000020:00000080:1.0:1787853484.027618:0:7610:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787853484.027622:0:7610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787853484.027817:0:7610:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9927441ba000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787853484.027824:0:7610:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787853484.027831:0:7610:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf1365f7cb05476f 00010000:00010000:2.0:1787853484.036218:0:7610:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1787853484.036527:0:7610:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787853484.040486:0:7610:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787853484.040823:0:7610:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787853484.050631:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787853484.053504:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787853484.055759:0:7610:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787853484.055771:0:7610:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853484.055777:0:7610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853484.055779:0:7610:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787853484.055783:0:7610:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787853484.055787:0:7610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853484.055788:0:7610:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787853484.055791:0:7610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787853484.055793:0:7610:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787853484.055841:0:7610:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853484.055844:0:7610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853484.055845:0:7610:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787853484.055849:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787853484.056329:0:7602:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1787853484.056358:0:7602:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787853484.056379:0:7602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f7000/0xcf1365f7cb05475a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054761 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.056390:0:7602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9927429f7000/0xcf1365f7cb05475a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054761 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853484.056398:0:7602:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9927441ba000 from 1 10000000:01000000:2.0:1787853484.056401:0:7602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787853484.056433:0:7602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71600/0xcf1365f7cb054776 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.056440:0:7602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992747f71600/0xcf1365f7cb054776 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.056467:0:7602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992747f71600/0xcf1365f7cb054776 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853484.056488:0:7602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992775482940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152094464:0@lo:101: 00000100:00100000:2.0:1787853484.056547:0:7602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853484.056624:0:7602:0:(client.c:2715:ptlrpc_set_wait()) set ffff992748eb8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787853484.063024:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152094464 00000100:00100000:3.0:1787853484.063038:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152094464 00000100:00100000:3.0:1787853484.063109:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787853484.063119:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:7602:x1874700152094464:12345-0@lo:101: 00010000:00010000:3.0:1787853484.063135:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853484.063152:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99275064ca00/0xcf1365f7cb05477d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb054776 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853484.063187:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99275064ca00/0xcf1365f7cb05477d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb054776 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853484.063197:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99275064ca00/0xcf1365f7cb05477d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054776 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853484.063206:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064ca00, rc 0) 00000100:00100000:3.0:1787853484.063279:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:7602:x1874700152094464:12345-0@lo:101: Request processed in 162us (6732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853484.063286:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787853484.063345:0:7602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992775482940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152094464:0@lo:101: 00010000:00010000:3.0:1787853484.063363:0:7602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992747f71600/0xcf1365f7cb054776 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05477d expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853484.063372:0:7602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992747f71600/0xcf1365f7cb054776 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb05477d expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853484.063473:0:7602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152094592:0@lo:501: 00000100:00100000:3.0:1787853484.063506:0:7602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853484.063531:0:7602:0:(client.c:2715:ptlrpc_set_wait()) set ffff992748f89540 going to sleep for 11 seconds 00000100:00100000:3.0:1787853484.063546:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152094592 00000100:00100000:3.0:1787853484.063550:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152094592 00000100:00100000:3.0:1787853484.063572:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787853484.063578:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:7602:x1874700152094592:12345-0@lo:501: 00000100:00100000:3.0:1787853484.063809:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:7602:x1874700152094592:12345-0@lo:501: Request processed in 230us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853484.063816:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787853484.063855:0:7602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152094592:0@lo:501: 00000100:00100000:3.0:1787853484.063887:0:7602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152094720:0@lo:503: 00000100:00100000:3.0:1787853484.063935:0:7602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853484.063948:0:7602:0:(client.c:2715:ptlrpc_set_wait()) set ffff992748f89540 going to sleep for 11 seconds 00000100:00100000:3.0:1787853484.063961:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152094720 00000100:00100000:3.0:1787853484.063964:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152094720 00000100:00100000:3.0:1787853484.063980:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787853484.063986:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:7602:x1874700152094720:12345-0@lo:503: 00000100:00100000:3.0:1787853484.064277:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:7602:x1874700152094720:12345-0@lo:503: Request processed in 289us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853484.064283:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787853484.064322:0:7602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152094720:0@lo:503: 00000040:00080000:3.0:1787853484.064547:0:7602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787853484.064598:0:7602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152094848:0@lo:502: 00000100:00100000:3.0:1787853484.064632:0:7602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853484.064647:0:7602:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747b45e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787853484.064659:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152094848 00000100:00100000:3.0:1787853484.064664:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152094848 00000100:00100000:3.0:1787853484.064699:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787853484.064705:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:7602:x1874700152094848:12345-0@lo:502: 00000100:00100000:3.0:1787853484.064826:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:7602:x1874700152094848:12345-0@lo:502: Request processed in 120us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853484.064833:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787853484.064868:0:7602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152094848:0@lo:502: 00000040:00080000:3.0:1787853484.065113:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787853484.065158:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787853484.065187:0:7602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152094976:0@lo:502: 00000100:00100000:3.0:1787853484.065220:0:7602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853484.065234:0:7602:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747b45e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787853484.065248:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152094976 00000100:00100000:3.0:1787853484.065251:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152094976 00000100:00100000:3.0:1787853484.065270:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787853484.065275:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:7602:x1874700152094976:12345-0@lo:502: 00000100:00100000:3.0:1787853484.065382:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:7602:x1874700152094976:12345-0@lo:502: Request processed in 105us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853484.065388:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787853484.065424:0:7602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152094976:0@lo:502: 00000040:00080000:3.0:1787853484.065495:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787853484.065504:0:7602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787853484.076618:0:7614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853484.076634:0:7614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853484.076636:0:7614:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787853484.076654:0:7614:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9927441ba000 00000020:00000080:1.0:1787853484.076656:0:7614:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787853484.076713:0:7614:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853484.076717:0:7614:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853484.076719:0:7614:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787853484.076722:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787853484.076880:0:7602:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787853484.077031:0:7602:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787853484.077138:0:7602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71600/0xcf1365f7cb054776 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05477d expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853484.077151:0:7602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992747f71600/0xcf1365f7cb054776 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05477d expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853484.077193:0:7602:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787853484.077196:0:7602:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9927441ba000 10000000:01000000:0.0:1787853484.077199:0:7602:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9927441ba000 10000000:01000000:0.0:1787853484.077202:0:7602:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787853484.077208:0:7602:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9927441ba000 from 1 10000000:01000000:0.0:1787853484.077210:0:7602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787853484.077242:0:7602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992740030400/0xcf1365f7cb054784 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853484.077251:0:7602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992740030400/0xcf1365f7cb054784 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853484.077262:0:7602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992740030400/0xcf1365f7cb054784 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853484.077282:0:7602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152095104:0@lo:101: 00000100:00100000:0.0:1787853484.077348:0:7602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853484.077391:0:7602:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927601d3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787853484.077505:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152095104 00000100:00100000:3.0:1787853484.077512:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152095104 00000100:00100000:3.0:1787853484.077557:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787853484.077566:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:7602:x1874700152095104:12345-0@lo:101: 00010000:00010000:3.0:1787853484.077577:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853484.077588:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99275064d600/0xcf1365f7cb05478b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb054784 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853484.077608:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99275064d600/0xcf1365f7cb05478b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb054784 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853484.077617:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99275064d600/0xcf1365f7cb05478b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054784 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853484.077625:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064d600, rc 0) 00000100:00100000:3.0:1787853484.077715:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:7602:x1874700152095104:12345-0@lo:101: Request processed in 150us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853484.077722:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787853484.078147:0:7602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152095104:0@lo:101: 00010000:00010000:1.0:1787853484.078162:0:7602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992740030400/0xcf1365f7cb054784 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05478b expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853484.078171:0:7602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992740030400/0xcf1365f7cb054784 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb05478b expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853484.078258:0:7602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152095232:0@lo:501: 00000100:00100000:1.0:1787853484.078287:0:7602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853484.078320:0:7602:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d5506c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853484.078394:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152095232 00000100:00100000:0.0:1787853484.078398:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152095232 00000100:00100000:0.0:1787853484.078431:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787853484.078438:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:7602:x1874700152095232:12345-0@lo:501: 00000100:00100000:0.0:1787853484.078645:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:7602:x1874700152095232:12345-0@lo:501: Request processed in 207us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853484.078652:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787853484.079391:0:7602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152095232:0@lo:501: 00000100:00100000:1.0:1787853484.079428:0:7602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152095360:0@lo:503: 00000100:00100000:1.0:1787853484.079473:0:7602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853484.079497:0:7602:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d5506c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853484.079780:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152095360 00000100:00100000:2.0:1787853484.079786:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152095360 00000100:00100000:2.0:1787853484.079815:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787853484.079823:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:7602:x1874700152095360:12345-0@lo:503: 00000100:00100000:2.0:1787853484.080316:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:7602:x1874700152095360:12345-0@lo:503: Request processed in 493us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853484.080323:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787853484.080464:0:7602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152095360:0@lo:503: 00000040:00080000:1.0:1787853484.080765:0:7602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787853484.080838:0:7602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152095488:0@lo:502: 00000100:00100000:1.0:1787853484.080879:0:7602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853484.080921:0:7602:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d5506c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853484.081299:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152095488 00000100:00100000:2.0:1787853484.081305:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152095488 00000100:00100000:2.0:1787853484.081336:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787853484.081344:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:7602:x1874700152095488:12345-0@lo:502: 00000100:00100000:2.0:1787853484.081530:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:7602:x1874700152095488:12345-0@lo:502: Request processed in 186us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853484.081537:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787853484.082391:0:7602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152095488:0@lo:502: 00000040:00080000:1.0:1787853484.082666:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787853484.083132:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787853484.083168:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787853484.083223:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787853484.083261:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787853484.083304:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787853484.083348:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787853484.083376:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787853484.083417:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787853484.083449:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787853484.083483:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787853484.083532:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787853484.083565:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787853484.083596:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787853484.083654:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787853484.083887:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787853484.083935:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787853484.084108:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787853484.084146:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787853484.084178:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787853484.084221:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787853484.084251:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787853484.084299:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787853484.084349:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787853484.084387:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787853484.084422:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787853484.084486:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787853484.084526:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1787853484.084560:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787853484.084607:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1787853484.084646:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1787853484.089865:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1787853484.090100:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1787853484.090184:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1787853484.090242:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1787853484.090297:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1787853484.090335:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1787853484.090381:0:7602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152095616:0@lo:502: 00000100:00100000:1.0:1787853484.090458:0:7602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853484.090545:0:7602:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d5506c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853484.091895:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152095616 00000100:00100000:3.0:1787853484.091904:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152095616 00000100:00100000:3.0:1787853484.092096:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787853484.092106:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:7602:x1874700152095616:12345-0@lo:502: 00000100:00100000:3.0:1787853484.092407:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:7602:x1874700152095616:12345-0@lo:502: Request processed in 302us (1948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853484.092415:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787853484.093310:0:7602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152095616:0@lo:502: 00000040:00080000:0.0:1787853484.094208:0:7602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1787853484.094226:0:7602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1787853484.095250:0:7615:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787853484.095265:0:7615:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9927756ecd70) 00000020:00000080:2.0:1787853484.095286:0:7615:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1787853484.095373:0:7615:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9927441ba000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787853484.095377:0:7615:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9927441ba000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787853484.095380:0:7615:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9927441ba000 3 00010000:00080000:2.0:1787853484.095408:0:7615:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9927756f0000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.110@tcp at head 00010000:00010000:2.0:1787853484.098243:0:7615:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1787853484.098503:0:7615:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787853484.098538:0:7615:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787853484.098549:0:7615:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcf1365f7cb054799 00000100:00080000:2.0:1787853484.098559:0:7615:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787853484.098564:0:7615:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9927756f0000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:2.0:1787853484.098595:0:7615:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9927754803c0 x1874700152095744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787853484.098622:0:7615:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787853484.098762:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927754803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3296:1874700152095744:0@lo:38: 00000100:00100000:0.0:1787853484.098823:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853484.098931:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152095744 00000100:00100000:2.0:1787853484.098937:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152095744 00000100:00100000:2.0:1787853484.098977:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787853484.098984:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3296:x1874700152095744:12345-0@lo:38: 00010000:00080000:2.0:1787853484.099003:0:5825:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:2.0:1787853484.099040:0:5825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcf1365f7cb0547a0 00000004:00100000:2.0:1787853484.099064:0:5825:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787853484.099093:0:5825:0:(import.c:65:import_set_state_nolock()) ffff992642913800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787853484.099142:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874700152095744:12345-0@lo:38: Request processed in 157us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853484.099149:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787853484.099200:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9927754803c0 x1874700152095744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787853494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853484.099210:0:3296:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787853484.099216:0:3296:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787853484.099222:0:3296:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787853484.099226:0:3296:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787853484.099228:0:3296:0:(import.c:65:import_set_state_nolock()) ffff9927756f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787853484.099242:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927754803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3296:1874700152095744:0@lo:38: 00000040:00080000:3.0:1787853484.102428:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1787853484.103122:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7617:1874700152095872:0@lo:901: 00000100:00100000:1.0:1787853484.103188:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853484.103220:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d5506c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853484.104229:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152096000:0@lo:400: 00000100:00100000:1.0:1787853484.104265:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853484.105578:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152095872 00000100:00100000:3.0:1787853484.105586:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152095872 00000100:00100000:3.0:1787853484.105650:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853484.105659:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7617:x1874700152095872:12345-0@lo:901: 00000100:00100000:3.0:1787853484.106050:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7617:x1874700152095872:12345-0@lo:901: Request processed in 391us (2860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853484.106058:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853484.106087:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1874700152096128:0@lo:400: 00000100:00100000:3.0:1787853484.106119:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853484.106352:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152096000 00000100:00100000:3.0:1787853484.106357:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152096000 00000100:00100000:3.0:1787853484.106380:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152096128 00000100:00100000:3.0:1787853484.106382:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152096128 00000100:00100000:3.0:1787853484.106394:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787853484.106400:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152096000:12345-0@lo:400: 00000100:00080000:2.0:1787853484.108085:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:0.0:1787853484.108281:0:7602:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787853484.108318:0:7602:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787853484.108344:0:7602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992740030400/0xcf1365f7cb054784 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05478b expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853484.108355:0:7602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992740030400/0xcf1365f7cb054784 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05478b expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787853484.108409:0:7602:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787853484.108412:0:7602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787853484.108413:0:7602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787853484.108414:0:7602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787853484.108416:0:7602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787853484.108417:0:7602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787853484.108419:0:7602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787853484.108420:0:7602:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787853484.108421:0:7602:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787853484.108422:0:7602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787853484.108424:0:7602:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787853484.108427:0:7602:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787853484.108433:0:7602:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787853484.108435:0:7602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787853484.108436:0:7602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787853484.108437:0:7602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787853484.108437:0:7602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787853484.108438:0:7602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787853484.108439:0:7602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787853484.108440:0:7602:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787853484.108441:0:7602:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787853484.108442:0:7602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787853484.108443:0:7602:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787853484.108463:0:7602:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787853484.108476:0:7602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152096256:0@lo:253: 00000100:00100000:0.0:1787853484.108528:0:7602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853484.108559:0:7602:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927601d3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787853484.108577:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152096256 00000100:00100000:0.0:1787853484.108582:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152096256 00000100:00100000:0.0:1787853484.108614:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787853484.108620:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:7602:x1874700152096256:12345-0@lo:253: 20000000:01000000:0.0:1787853484.108651:0:5819:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787853484.108662:0:5819:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787853484.109457:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787853484.109467:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:0.0:1787853484.109513:0:7617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff992761e68f00 x1874700152095872/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787853500 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853484.109527:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7617:1874700152095872:0@lo:901: 00000100:00100000:2.0:1787853484.109856:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787853484.109867:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874700152096128:12345-0@lo:400: 00000100:00100000:2.0:1787853484.109944:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874700152096128:12345-0@lo:400: Request processed in 80us (3825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853484.109951:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787853484.110359:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152096000:12345-0@lo:400: Request processed in 3955us (6090us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853484.110375:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787853484.110412:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff992761ea5a40 x1874700152096128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853484.110423:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1874700152096128:0@lo:400: 00010000:00080000:1.0:1787853484.115268:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff992761ea5e00 x1874700152096000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853484.115287:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152096000:0@lo:400: 20000000:01000000:0.0:1787853484.173017:0:5819:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787853484.173038:0:5819:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787853484.173310:0:5840:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787853484.173315:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787853484.173335:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99275064d000/0xcf1365f7cb0547a7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853484.173352:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9927429f7400/0xcf1365f7cb0546f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0546f1 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853484.173361:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99275064d000/0xcf1365f7cb0547a7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853484.173397:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9927429f7400/0xcf1365f7cb0546f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb0546f1 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853484.173410:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9927429f7400/0xcf1365f7cb0546f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb0546f1 expref: 14 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853484.173423:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea9a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5840:1874700152096384:0@lo:104: 00000100:00100000:3.0:1787853484.173485:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853484.173541:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff992766048d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787853484.173604:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152096384 00000100:00100000:2.0:1787853484.173611:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152096384 00000100:00100000:2.0:1787853484.173662:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787853484.173702:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992760d7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:5840:x1874700152096384:12345-0@lo:104: 00010000:00010000:2.0:1787853484.173715:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff99275064d200/0xcf1365f7cb0546f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0546f8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.173766:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787853484.173772:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992760d7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:5840:x1874700152096384:12345-0@lo:104: Request processed in 103us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853484.173780:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787853484.173800:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853484.173805:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff99275064d200/0xcf1365f7cb0546f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0546f8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.173812:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d200 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1787853484.173816:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff99275064d200/0xcf1365f7cb0546f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb0546f8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.173824:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff99275064d200/0xcf1365f7cb0546f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb0546f8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853484.173848:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff99275064d200/0xcf1365f7cb0546f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb0546f8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853484.173854:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787853484.173883:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff99275064d200/0xcf1365f7cb0546f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0546f8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.173890:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853484.173920:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff99275064d200/0xcf1365f7cb0546f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0546f8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.173928:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff99275064d200/0xcf1365f7cb0546f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0546f8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.173944:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853484.173945:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853484.173947:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853484.173975:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927754803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152096512:0@lo:103: 00000100:00100000:2.0:1787853484.174006:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853484.174045:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152096512 00000100:00100000:2.0:1787853484.174245:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152096512 00010000:00010000:2.0:1787853484.174263:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9927429f7400/0xcf1365f7cb0546f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0546f1 expref: 15 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853484.174294:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787853484.174301:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274415d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:3299:x1874700152096512:12345-0@lo:103: 00010000:00010000:2.0:1787853484.174311:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853484.174315:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9927429f7400/0xcf1365f7cb0546f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0546f1 expref: 15 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.174331:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9927429f7400/0xcf1365f7cb0546f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb0546f1 expref: 15 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.174346:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99275064d000/0xcf1365f7cb0547a7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.174353:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99275064d000/0xcf1365f7cb0547a7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787853484.174366:0:5811:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002119374s 00010000:00010000:2.0:1787853484.174370:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99275064d000/0xcf1365f7cb0547a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.174377:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99275064d000/0xcf1365f7cb0547a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.174384:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99275064d000/0xcf1365f7cb0547a7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.174391:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99275064d000/0xcf1365f7cb0547a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.174396:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d000 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853484.174400:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99275064d000/0xcf1365f7cb0547a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.174407:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99275064d000/0xcf1365f7cb0547a7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.174416:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99275064d000/0xcf1365f7cb0547a7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853484.174435:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853484.174465:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274415d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:3299:x1874700152096512:12345-0@lo:103: Request processed in 165us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853484.174472:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787853484.174529:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927754803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152096512:0@lo:103: 00010000:00010000:3.0:1787853484.175181:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927429f7400/0xcf1365f7cb0546f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb0546f1 expref: 14 pid: 5818 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853484.175193:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea9a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5840:1874700152096384:0@lo:104: 00010000:00010000:3.0:1787853484.175208:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99275064d000/0xcf1365f7cb0547a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853484.175234:0:5840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99275064d000/0xcf1365f7cb0547a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853484.175239:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99275064d000/0xcf1365f7cb0547a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853484.175246:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99275064d000/0xcf1365f7cb0547a7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853484.191073:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:7602:x1874700152096256:12345-0@lo:253: Request processed in 82445us (82536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853484.191087:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787853484.191241:0:7602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7602:1874700152096256:0@lo:253: 10000000:01000000:0.0:1787853484.191256:0:7602:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787853484.191259:0:7602:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787853484.191260:0:7602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787853484.191275:0:7602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787853484.191276:0:7602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787853484.191278:0:7602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787853484.191279:0:7602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787853484.191281:0:7602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787853484.191282:0:7602:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787853484.191283:0:7602:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787853484.191285:0:7602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787853484.191287:0:7602:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787853484.191302:0:7602:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787853484.198534:0:7602:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787853484.199137:0:7602:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787853484.199379:0:7602:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787853484.199553:0:7602:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787853484.199765:0:7602:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787853484.200230:0:7602:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787853484.201478:0:7602:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787853484.443442:0:7602:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787853484.443452:0:7602:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787853484.443517:0:7602:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787853484.443590:0:7602:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.110@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787853484.443622:0:7602:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787853484.443656:0:7602:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787853484.934319:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853485.958877:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853486.986413:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853488.005884:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853488.966114:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152096640:0@lo:13: 00000100:00100000:2.0:1787853488.966208:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853488.967656:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152096640 00000100:00100000:1.0:1787853488.967704:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152096640 00000100:00100000:1.0:1787853488.967807:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787853488.967818:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775480f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152096640:12345-0@lo:13: 00002000:00000024:1.0:1787853488.967868:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853488.967975:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775480f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152096640:12345-0@lo:13: Request processed in 158us (1766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853488.967982:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787853488.968604:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787853488.968654:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992761e6b0c0 x1874700152096640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853488.968717:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152096640:0@lo:13: 00010000:00010000:0.0:1787853489.029894:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853489.487627:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992775483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152096896:0@lo:400: 00000100:00100000:2.0:1787853489.487942:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853489.488022:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787853489.488028:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992775483c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152096768:0@lo:400: 00000100:00100000:2.0:1787853489.488060:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853489.488095:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992775480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152097024:0@lo:400: 00000100:00100000:2.0:1787853489.488117:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853489.488152:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787853489.488157:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992775481e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152097152:0@lo:400: 00000100:00100000:2.0:1787853489.488177:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853489.488210:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152096896 00000100:00100000:2.0:1787853489.488218:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152096896 00000100:00100000:2.0:1787853489.488265:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152097024 00000100:00100000:2.0:1787853489.488267:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152097024 00000100:00100000:2.0:1787853489.488289:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152097152 00000100:00100000:2.0:1787853489.488291:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152097152 00000100:00100000:2.0:1787853489.488306:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787853489.488314:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775480780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152096896:12345-0@lo:400: 00000100:00100000:2.0:1787853489.488364:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775480780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152096896:12345-0@lo:400: Request processed in 50us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853489.488372:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787853489.488459:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787853489.488465:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927754803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152097024:12345-0@lo:400: 00000100:00100000:2.0:1787853489.488500:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927754803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152097024:12345-0@lo:400: Request processed in 35us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853489.488506:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787853489.488517:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787853489.488523:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775482940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152097152:12345-0@lo:400: 00000100:00100000:2.0:1787853489.488549:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775482940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152097152:12345-0@lo:400: Request processed in 26us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853489.488555:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787853489.488574:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152096768 00000100:00100000:2.0:1787853489.488589:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152096768 00000100:00100000:2.0:1787853489.488616:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787853489.488622:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:3298:x1874700152096768:12345-0@lo:400: 00000100:00100000:2.0:1787853489.488663:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:3298:x1874700152096768:12345-0@lo:400: Request processed in 41us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853489.488670:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1787853489.496001:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787853489.496075:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992775481e00 x1874700152097152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853489.496096:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992775481e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152097152:0@lo:400: 00010000:00080000:2.0:1787853489.496113:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992775480000 x1874700152097024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853489.496123:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992775480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152097024:0@lo:400: 00000100:00100000:2.0:1787853489.496171:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992775483c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152096768:0@lo:400: 00010000:00080000:2.0:1787853489.496186:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992775483480 x1874700152096896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853489.496195:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992775483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152096896:0@lo:400: 00010000:00010000:0.0:1787853490.053798:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787853491.014034:0:5821:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787853491.014042:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9927660b0000 from 30 10000000:01000000:3.0:1787853491.014048:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787853491.014093:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff99275064d400/0xcf1365f7cb0547ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853491.014105:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff99275064d400/0xcf1365f7cb0547ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853491.014116:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff99275064d400/0xcf1365f7cb0547ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853491.014140:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152097280:0@lo:101: 00000100:00100000:3.0:1787853491.014208:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853491.014257:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274335fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787853491.014283:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152097280 00000100:00100000:3.0:1787853491.014298:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152097280 00000100:00100000:3.0:1787853491.014338:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787853491.014346:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:5821:x1874700152097280:12345-0@lo:101: 00010000:00010000:3.0:1787853491.014359:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853491.014369:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99275064c000/0xcf1365f7cb0547b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0547ae expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853491.014391:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99275064c000/0xcf1365f7cb0547b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0547ae expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853491.014402:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99275064c000/0xcf1365f7cb0547b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0547ae expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853491.014411:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064c000, rc 0) 00000100:00100000:3.0:1787853491.014463:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:5821:x1874700152097280:12345-0@lo:101: Request processed in 117us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853491.014471:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787853491.014511:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152097280:0@lo:101: 00010000:00010000:3.0:1787853491.014523:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff99275064d400/0xcf1365f7cb0547ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0547b5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853491.014532:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff99275064d400/0xcf1365f7cb0547ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0547b5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853491.014576:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152097408:0@lo:501: 00000100:00100000:3.0:1787853491.014598:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853491.014614:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274335fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787853491.014626:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152097408 00000100:00100000:3.0:1787853491.014629:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152097408 00000100:00100000:3.0:1787853491.014655:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787853491.014660:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:5821:x1874700152097408:12345-0@lo:501: 00000100:00100000:3.0:1787853491.015088:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:5821:x1874700152097408:12345-0@lo:501: Request processed in 427us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853491.015097:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787853491.015134:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152097408:0@lo:501: 00000100:00100000:3.0:1787853491.015164:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152097536:0@lo:503: 00000100:00100000:3.0:1787853491.015206:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853491.015220:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274335fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787853491.015232:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152097536 00000100:00100000:3.0:1787853491.015236:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152097536 00000100:00100000:3.0:1787853491.015260:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787853491.015266:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:5821:x1874700152097536:12345-0@lo:503: 00000100:00100000:3.0:1787853491.015614:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:5821:x1874700152097536:12345-0@lo:503: Request processed in 346us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853491.015622:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787853491.015705:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152097536:0@lo:503: 00000100:00100000:3.0:1787853491.015900:0:7909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7909:1874700152097664:0@lo:502: 00000100:00100000:3.0:1787853491.015945:0:7909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853491.015967:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152097664 00000100:00100000:3.0:1787853491.015971:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152097664 00000100:00100000:3.0:1787853491.016000:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787853491.016011:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:7909:x1874700152097664:12345-0@lo:502: 00000100:00100000:3.0:1787853491.016273:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:7909:x1874700152097664:12345-0@lo:502: Request processed in 264us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853491.016290:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787853491.016324:0:7909:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274531ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787853491.016340:0:7909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7909:1874700152097664:0@lo:502: 00000100:00100000:3.0:1787853491.016391:0:7909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7909:1874700152097792:0@lo:502: 00000100:00100000:3.0:1787853491.016437:0:7909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853491.016460:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152097792 00000100:00100000:3.0:1787853491.016464:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152097792 00000100:00100000:3.0:1787853491.016491:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787853491.016502:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:7909:x1874700152097792:12345-0@lo:502: 00000100:00100000:3.0:1787853491.016656:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:7909:x1874700152097792:12345-0@lo:502: Request processed in 155us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853491.016663:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787853491.016741:0:7909:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747a1bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853491.016756:0:7909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7909:1874700152097792:0@lo:502: 00000040:00080000:3.0:1787853491.016777:0:7909:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787853491.016835:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787853491.018430:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787853491.018444:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff99275064d400/0xcf1365f7cb0547ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0547b5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853491.018456:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff99275064d400/0xcf1365f7cb0547ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0547b5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853491.018465:0:5821:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787853491.018468:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787853491.018470:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787853491.018500:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff99275064c200/0xcf1365f7cb0547bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853491.018513:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff99275064c200/0xcf1365f7cb0547bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853491.018523:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff99275064c200/0xcf1365f7cb0547bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853491.018542:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152097920:0@lo:101: 00000100:00100000:3.0:1787853491.018592:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853491.018619:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276e832f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787853491.018644:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152097920 00000100:00100000:3.0:1787853491.018650:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152097920 00000100:00100000:3.0:1787853491.018699:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787853491.018708:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:5821:x1874700152097920:12345-0@lo:101: 00010000:00010000:3.0:1787853491.018720:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853491.018732:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99275064d800/0xcf1365f7cb0547c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0547bc expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853491.018753:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99275064d800/0xcf1365f7cb0547c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0547bc expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853491.018763:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99275064d800/0xcf1365f7cb0547c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0547bc expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853491.018772:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064d800, rc 0) 00000100:00100000:3.0:1787853491.018805:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:5821:x1874700152097920:12345-0@lo:101: Request processed in 98us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853491.018812:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787853491.018853:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152097920:0@lo:101: 00010000:00010000:3.0:1787853491.018888:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff99275064c200/0xcf1365f7cb0547bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0547c3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853491.018898:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff99275064c200/0xcf1365f7cb0547bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0547c3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853491.018942:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152098048:0@lo:501: 00000100:00100000:3.0:1787853491.018966:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853491.018978:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276e832f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787853491.018989:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152098048 00000100:00100000:3.0:1787853491.018992:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152098048 00000100:00100000:3.0:1787853491.019011:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787853491.019017:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:5821:x1874700152098048:12345-0@lo:501: 00000100:00100000:3.0:1787853491.019293:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:5821:x1874700152098048:12345-0@lo:501: Request processed in 274us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853491.019300:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787853491.021079:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152098048:0@lo:501: 00000100:00100000:1.0:1787853491.021192:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e6b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152098176:0@lo:503: 00000100:00100000:1.0:1787853491.021292:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853491.021360:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927601d3780 going to sleep for 11 seconds 00000100:00100000:0.0:1787853491.023551:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152098176 00000100:00100000:0.0:1787853491.023569:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152098176 00000100:00100000:0.0:1787853491.023660:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787853491.023689:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:5821:x1874700152098176:12345-0@lo:503: 00000100:00100000:0.0:1787853491.025810:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:5821:x1874700152098176:12345-0@lo:503: Request processed in 2131us (4510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853491.025825:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787853491.026811:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e6b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152098176:0@lo:503: 00000100:00100000:1.0:1787853491.029824:0:7911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e6b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7911:1874700152098304:0@lo:502: 00000100:00100000:1.0:1787853491.029964:0:7911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853491.030020:0:7911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927601d3780 going to sleep for 11 seconds 00000100:00100000:0.0:1787853491.030278:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152098304 00000100:00100000:0.0:1787853491.030287:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152098304 00000100:00100000:0.0:1787853491.030345:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787853491.030357:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:7911:x1874700152098304:12345-0@lo:502: 00000100:00100000:0.0:1787853491.030739:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:7911:x1874700152098304:12345-0@lo:502: Request processed in 382us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853491.030757:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787853491.035545:0:7911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e6b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7911:1874700152098304:0@lo:502: 00000020:01000000:1.0:1787853491.035616:0:7911:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853491.035632:0:7911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853491.035636:0:7911:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787853491.035643:0:7911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787853491.035645:0:7911:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787853491.035707:0:7911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e6b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7911:1874700152098432:0@lo:502: 00000100:00100000:1.0:1787853491.035813:0:7911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853491.035865:0:7911:0:(client.c:2715:ptlrpc_set_wait()) set ffff992766048300 going to sleep for 11 seconds 00000100:00100000:3.0:1787853491.036622:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152098432 00000100:00100000:3.0:1787853491.036637:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152098432 00000100:00100000:3.0:1787853491.037292:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787853491.037307:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:7911:x1874700152098432:12345-0@lo:502: 00000100:00100000:3.0:1787853491.037728:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:7911:x1874700152098432:12345-0@lo:502: Request processed in 425us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853491.037739:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787853491.039985:0:7911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e6b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7911:1874700152098432:0@lo:502: 00000020:01000000:2.0:1787853491.040039:0:7911:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853491.040049:0:7911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853491.040052:0:7911:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787853491.040059:0:7911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787853491.040171:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787853491.040222:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787853491.040238:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff99275064c200/0xcf1365f7cb0547bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0547c3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853491.040253:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff99275064c200/0xcf1365f7cb0547bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0547c3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853491.040266:0:5821:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787853491.040269:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9927436b6000 from 30 10000000:01000000:0.0:1787853491.040273:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787853491.040326:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992740031a00/0xcf1365f7cb0547ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853491.040334:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992740031a00/0xcf1365f7cb0547ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853491.040346:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992740031a00/0xcf1365f7cb0547ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853491.040371:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152098560:0@lo:101: 00000100:00100000:0.0:1787853491.040458:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853491.040542:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277d314180 going to sleep for 11 seconds 00000100:00100000:2.0:1787853491.040651:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152098560 00000100:00100000:2.0:1787853491.040660:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152098560 00000100:00100000:2.0:1787853491.040771:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787853491.040780:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:5821:x1874700152098560:12345-0@lo:101: 00010000:00010000:2.0:1787853491.040795:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853491.040820:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992747f71e00/0xcf1365f7cb0547d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0547ca expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853491.040851:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992747f71e00/0xcf1365f7cb0547d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0547ca expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853491.040863:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992747f71e00/0xcf1365f7cb0547d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0547ca expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853491.040883:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71e00, rc 0) 00000100:00100000:2.0:1787853491.040950:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:5821:x1874700152098560:12345-0@lo:101: Request processed in 171us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853491.040957:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787853491.041011:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152098560:0@lo:101: 00010000:00010000:2.0:1787853491.041026:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992740031a00/0xcf1365f7cb0547ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0547d1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853491.041035:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992740031a00/0xcf1365f7cb0547ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0547d1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853491.041105:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992775483480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152098688:0@lo:501: 00000100:00100000:2.0:1787853491.041133:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853491.041161:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1787853491.042256:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152098688 00000100:00100000:0.0:1787853491.042269:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152098688 00000100:00100000:0.0:1787853491.042336:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787853491.042347:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:5821:x1874700152098688:12345-0@lo:501: 00000100:00100000:0.0:1787853491.045846:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:5821:x1874700152098688:12345-0@lo:501: Request processed in 3487us (4697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853491.046032:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787853491.046133:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992775483480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152098688:0@lo:501: 00000100:00100000:2.0:1787853491.046189:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992775483480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152098816:0@lo:503: 00000100:00100000:2.0:1787853491.046259:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853491.046308:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0480 going to sleep for 11 seconds 00000100:00100000:1.0:1787853491.046748:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152098816 00000100:00100000:1.0:1787853491.046759:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152098816 00000100:00100000:1.0:1787853491.046825:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787853491.046834:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:5821:x1874700152098816:12345-0@lo:503: 00000100:00100000:1.0:1787853491.047021:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:5821:x1874700152098816:12345-0@lo:503: Request processed in 188us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853491.047029:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787853491.048717:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992775483480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152098816:0@lo:503: 00000100:00100000:0.0:1787853491.049215:0:7914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7914:1874700152098944:0@lo:502: 00000100:00100000:0.0:1787853491.049281:0:7914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853491.049327:0:7914:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277d314c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787853491.049379:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152098944 00000100:00100000:1.0:1787853491.049385:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152098944 00000100:00100000:1.0:1787853491.049477:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787853491.049488:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:7914:x1874700152098944:12345-0@lo:502: 00000100:00100000:1.0:1787853491.049782:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:7914:x1874700152098944:12345-0@lo:502: Request processed in 295us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853491.049790:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787853491.050060:0:7914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7914:1874700152098944:0@lo:502: 00000100:00100000:0.0:1787853491.050117:0:7914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7914:1874700152099072:0@lo:502: 00000100:00100000:0.0:1787853491.050155:0:7914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853491.050290:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152099072 00000100:00100000:2.0:1787853491.050296:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152099072 00000100:00100000:2.0:1787853491.050320:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787853491.050327:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:7914:x1874700152099072:12345-0@lo:502: 00000100:00100000:2.0:1787853491.050501:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:7914:x1874700152099072:12345-0@lo:502: Request processed in 174us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853491.050508:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787853491.050627:0:7914:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277d314c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787853491.050641:0:7914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7914:1874700152099072:0@lo:502: 00000040:00080000:0.0:1787853491.050664:0:7914:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787853491.052037:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787853491.052065:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787853491.052075:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992740031a00/0xcf1365f7cb0547ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0547d1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853491.052087:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992740031a00/0xcf1365f7cb0547ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0547d1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853491.052096:0:5821:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787853491.052100:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9927436b6000 from 5 10000000:01000000:2.0:1787853491.052103:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787853491.052414:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb0547d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853491.052426:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb0547d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853491.052448:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb0547d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853491.052467:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992775483480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152099200:0@lo:101: 00000100:00100000:3.0:1787853491.052530:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853491.052572:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276e832180 going to sleep for 11 seconds 00000100:00100000:2.0:1787853491.052819:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152099200 00000100:00100000:2.0:1787853491.052827:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152099200 00000100:00100000:2.0:1787853491.052868:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787853491.052889:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:5821:x1874700152099200:12345-0@lo:101: 00010000:00010000:2.0:1787853491.052901:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853491.052913:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992747f70600/0xcf1365f7cb0547df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0547d8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853491.052934:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992747f70600/0xcf1365f7cb0547df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0547d8 expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853491.052953:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992747f70600/0xcf1365f7cb0547df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0547d8 expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853491.052961:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70600, rc 0) 00000100:00100000:2.0:1787853491.053001:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152099200:12345-0@lo:101: Request processed in 115us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853491.053008:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787853491.053183:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992775483480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152099200:0@lo:101: 00010000:00010000:3.0:1787853491.053197:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb0547d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0547df expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853491.053206:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb0547d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0547df expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853491.053791:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152099328:0@lo:256: 00000100:00100000:3.0:1787853491.053833:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853491.053865:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276e832180 going to sleep for 11 seconds 00000100:00100000:3.0:1787853491.053892:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152099328 00000100:00100000:3.0:1787853491.053897:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152099328 00000100:00100000:3.0:1787853491.053935:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787853491.053945:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152099328:12345-0@lo:256: 20000000:01000000:3.0:1787853491.053960:0:5816:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787853491.054033:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787853491.054037:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787853491.054135:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152099328:12345-0@lo:256: Request processed in 191us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853491.054144:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787853491.054149:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152099328:0@lo:256: 10000000:01000000:0.0:1787853491.054199:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787853491.054206:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb0547d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0547df expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853491.054215:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb0547d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0547df expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853491.054223:0:5821:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787853491.054225:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787853491.054228:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787853491.054249:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992740030a00/0xcf1365f7cb0547e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853491.054256:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992740030a00/0xcf1365f7cb0547e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853491.054275:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992740030a00/0xcf1365f7cb0547e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853491.054288:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152099456:0@lo:101: 00000100:00100000:0.0:1787853491.054317:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853491.054342:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277d314c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853491.054498:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152099456 00000100:00100000:2.0:1787853491.054503:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152099456 00000100:00100000:2.0:1787853491.054535:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787853491.054543:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152099456:12345-0@lo:101: 00010000:00010000:2.0:1787853491.054552:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853491.054563:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992747f70e00/0xcf1365f7cb0547ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0547e6 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853491.054580:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992747f70e00/0xcf1365f7cb0547ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0547e6 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853491.054589:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992747f70e00/0xcf1365f7cb0547ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0547e6 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853491.054597:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70e00, rc 0) 00000100:00100000:0.0:1787853491.054916:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152099456:0@lo:101: 00010000:00010000:0.0:1787853491.054931:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992740030a00/0xcf1365f7cb0547e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0547ed expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853491.054938:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992740030a00/0xcf1365f7cb0547e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0547ed expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853491.054989:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152099584:0@lo:501: 00000100:00100000:0.0:1787853491.055169:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853491.055195:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277d314c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787853491.055210:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152099584 00000100:00100000:0.0:1787853491.055215:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152099584 00000100:00100000:0.0:1787853491.055250:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787853491.055258:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152099584:12345-0@lo:501: 00000100:00100000:0.0:1787853491.055582:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152099584:12345-0@lo:501: Request processed in 323us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853491.055589:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787853491.055632:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152099584:0@lo:501: 00000100:00100000:0.0:1787853491.055667:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152099712:0@lo:503: 00000100:00100000:0.0:1787853491.055740:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853491.055780:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277d314c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853491.055846:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152099456:12345-0@lo:101: Request processed in 1303us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853491.055853:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787853491.055882:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152099712 00000100:00100000:2.0:1787853491.055886:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152099712 00000100:00100000:2.0:1787853491.055944:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787853491.055959:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152099712:12345-0@lo:503: 00000100:00100000:2.0:1787853491.056411:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152099712:12345-0@lo:503: Request processed in 452us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853491.056419:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787853491.056492:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152099712:0@lo:503: 00000100:00100000:2.0:1787853491.056907:0:7917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992775483c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7917:1874700152099840:0@lo:502: 00000100:00100000:2.0:1787853491.056952:0:7917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853491.057010:0:7917:0:(client.c:2715:ptlrpc_set_wait()) set ffff992748fb2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787853491.057042:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152099840 00000100:00100000:1.0:1787853491.057047:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152099840 00000100:00100000:1.0:1787853491.057110:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787853491.057118:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:7917:x1874700152099840:12345-0@lo:502: 00000100:00100000:1.0:1787853491.057417:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:7917:x1874700152099840:12345-0@lo:502: Request processed in 298us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853491.057425:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787853491.057497:0:7917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992775483c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7917:1874700152099840:0@lo:502: 00000020:01000000:2.0:1787853491.057522:0:7917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787853491.057529:0:7917:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787853491.057534:0:7917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853491.057536:0:7917:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787853491.057541:0:7917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787853491.057545:0:7917:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.110@tcp to nid 0x20000c0a8ce6e (192.168.206.110@tcp) 00000020:01000000:2.0:1787853491.057564:0:7917:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787853491.057566:0:7917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787853491.057579:0:7917:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9927756e8000) 00000020:00000080:2.0:1787853491.057597:0:7917:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787853491.057603:0:7917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787853491.057704:0:7917:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787853491.057709:0:7917:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787853491.057715:0:7917:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf1365f7cb0547fb 00010000:00080000:2.0:1787853491.057742:0:7917:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99277bee3000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.110@tcp at head 00010000:00010000:2.0:1787853491.057990:0:7917:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1787853491.058297:0:7917:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787853491.058309:0:7917:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787853491.058900:0:7917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787853491.059129:0:7917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787853491.059197:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787853491.059285:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787853491.060198:0:7918:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787853491.060204:0:7918:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787853491.066512:0:7917:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787853491.066527:0:7917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787853491.066560:0:7917:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787853491.066584:0:7917:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf1365f7cb054802 00000100:00080000:0.0:1787853491.066594:0:7917:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787853491.066600:0:7917:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99277bee3000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:0.0:1787853491.066635:0:7917:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff992761ea7480 x1874700152099968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787853491.066718:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1874700152099968:0@lo:8: 00000100:00100000:2.0:1787853491.066791:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853491.066896:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152099968 00000100:00100000:1.0:1787853491.066903:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152099968 00000100:00100000:1.0:1787853491.066939:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787853491.066946:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775483c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3296:x1874700152099968:12345-0@lo:8: 00010000:00080000:1.0:1787853491.066970:0:6673:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:1.0:1787853491.066995:0:6673:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf1365f7cb054809 00002000:00100000:1.0:1787853491.067008:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99276f6b7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113953 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787853491.067012:0:6673:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1787853491.067016:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787853491.067141:0:6673:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787853491.067283:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787853491.067305:0:6673:0:(import.c:65:import_set_state_nolock()) ffff99276f6b5800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1787853491.067401:0:7917:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787853491.067466:0:7917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853491.067471:0:7917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853491.067473:0:7917:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787853491.067477:0:7917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853491.067480:0:7917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853491.067482:0:7917:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787853491.067485:0:7917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787853491.067487:0:7917:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787853491.067514:0:7917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7917:1874700152100096:0@lo:502: 00000100:00100000:0.0:1787853491.067566:0:7917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853491.067594:0:7917:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277d3149c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853491.067819:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775483c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3296:x1874700152099968:12345-0@lo:8: Request processed in 871us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853491.067836:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787853491.069012:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1874700152100352:0@lo:400: 00000100:00100000:3.0:1787853491.069061:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853491.069088:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787853491.069094:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152100224:0@lo:400: 00000100:00100000:3.0:1787853491.069116:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853491.069140:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152100480:0@lo:400: 00000100:00100000:3.0:1787853491.069161:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853491.069180:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787853491.069186:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152100608:0@lo:400: 00000100:00100000:3.0:1787853491.069206:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853491.069286:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152100352 00000100:00100000:3.0:1787853491.069292:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152100352 00000100:00100000:3.0:1787853491.069392:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152100224 00000100:00100000:3.0:1787853491.069396:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152100224 00000100:00100000:3.0:1787853491.069409:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152100608 00000100:00100000:3.0:1787853491.069411:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152100608 00000100:00100000:3.0:1787853491.069426:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787853491.069433:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874700152100352:12345-0@lo:400: 00000100:00100000:3.0:1787853491.069477:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874700152100352:12345-0@lo:400: Request processed in 43us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853491.069483:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787853491.069496:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787853491.069502:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152100224:12345-0@lo:400: 00000100:00100000:3.0:1787853491.069525:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152100224:12345-0@lo:400: Request processed in 24us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853491.069532:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787853491.069543:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787853491.069549:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152100608:12345-0@lo:400: 00000100:00100000:3.0:1787853491.069589:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152100608:12345-0@lo:400: Request processed in 40us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853491.069595:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787853491.069616:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152100480 00000100:00100000:3.0:1787853491.069620:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152100480 00000100:00100000:3.0:1787853491.069646:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787853491.069653:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152100480:12345-0@lo:400: 00000100:00100000:3.0:1787853491.069702:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152100480:12345-0@lo:400: Request processed in 50us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853491.069709:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787853491.069746:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992748f5c780 x1874700152100608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853491.069761:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152100608:0@lo:400: 00010000:00080000:3.0:1787853491.069772:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992748f5de00 x1874700152100480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853491.069781:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152100480:0@lo:400: 00010000:00080000:3.0:1787853491.069805:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992748f5d680 x1874700152100224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853491.069814:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152100224:0@lo:400: 00010000:00080000:3.0:1787853491.069824:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992748f5ed00 x1874700152100352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853491.069832:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1874700152100352:0@lo:400: 00010000:00080000:2.0:1787853491.070470:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992761ea7480 x1874700152099968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787853501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853491.070481:0:3296:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787853491.070488:0:3296:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787853491.070495:0:3296:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787853491.070500:0:3296:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787853491.070503:0:3296:0:(import.c:65:import_set_state_nolock()) ffff99277bee3000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787853491.070517:0:3296:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787853491.070522:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1874700152099968:0@lo:8: 00000100:00100000:2.0:1787853491.070549:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152100096 00000100:00100000:2.0:1787853491.070553:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152100096 00000100:00100000:2.0:1787853491.070582:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787853491.070589:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:7917:x1874700152100096:12345-0@lo:502: 00000100:00080000:0.0:1787853491.070718:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787853491.070723:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853491.070854:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:7917:x1874700152100096:12345-0@lo:502: Request processed in 264us (3288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853491.070866:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000004:00080000:2.0:1787853491.070923:0:7918:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787853491.071042:0:7918:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 185368367950ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787853491.071201:0:7917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:7917:1874700152100096:0@lo:502: 00000020:01000000:0.0:1787853491.071227:0:7917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853491.075739:0:7917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853491.075746:0:7917:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787853491.075752:0:7917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1787853491.076028:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787853491.076057:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787853491.076067:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992740030a00/0xcf1365f7cb0547e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0547ed expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853491.076085:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992740030a00/0xcf1365f7cb0547e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0547ed expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853491.076096:0:5821:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787853491.076100:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99274364b3a0 from 1 10000000:01000000:0.0:1787853491.076103:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787853491.076134:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb054810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853491.076142:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb054810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853491.076152:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb054810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853491.076173:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152100736:0@lo:101: 00000100:00100000:0.0:1787853491.076241:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853491.076283:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277d3149c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853491.076304:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152100736 00000100:00100000:0.0:1787853491.076310:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152100736 00000100:00100000:0.0:1787853491.076576:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787853491.076587:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152100736:12345-0@lo:101: 00010000:00010000:0.0:1787853491.076600:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853491.076613:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992740031400/0xcf1365f7cb054817 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb054810 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853491.076635:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992740031400/0xcf1365f7cb054817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb054810 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853491.076656:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992740031400/0xcf1365f7cb054817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054810 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853491.076665:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992740031400, rc 0) 00000100:00100000:0.0:1787853491.076762:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152100736:12345-0@lo:101: Request processed in 177us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853491.076769:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787853491.076819:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152100736:0@lo:101: 00010000:00010000:0.0:1787853491.076832:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb054810 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054817 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853491.076840:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb054810 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054817 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853491.076906:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152100864:0@lo:501: 00000100:00100000:0.0:1787853491.076938:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853491.076967:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277d3149c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853491.076982:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152100864 00000100:00100000:0.0:1787853491.076986:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152100864 00000100:00100000:0.0:1787853491.077013:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787853491.077021:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152100864:12345-0@lo:501: 00000100:00100000:0.0:1787853491.077195:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152100864:12345-0@lo:501: Request processed in 175us (258us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787853491.077202:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787853491.077240:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152100864:0@lo:501: 10000000:01000000:0.0:1787853491.077265:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787853491.077276:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb054810 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054817 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853491.077284:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb054810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054817 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853491.077794:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787853491.131102:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1787853491.131257:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992775480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152100992:0@lo:13: 00000100:00100000:0.0:1787853491.131350:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853491.131456:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152100992 00000100:00100000:1.0:1787853491.131466:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152100992 00000100:00100000:1.0:1787853491.131531:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787853491.131540:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1874700152100992:12345-0@lo:13: 00002000:00000024:1.0:1787853491.131579:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787853491.131638:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1874700152100992:12345-0@lo:13: Request processed in 99us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853491.131646:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787853491.131713:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992775480000 x1874700152100992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853491.131734:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992775480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152100992:0@lo:13: 00000100:00080000:0.0:1787853491.131834:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787853491.133598:0:7921:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787853491.133705:0:7921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992775481e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7921:1874700152101120:0@lo:7: 00000100:00100000:2.0:1787853491.133792:0:7921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853491.133830:0:7921:0:(client.c:2715:ptlrpc_set_wait()) set ffff992748fb2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787853491.133859:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152101120 00000100:00100000:2.0:1787853491.133892:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152101120 00000100:00100000:2.0:1787853491.133949:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787853491.133958:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775482d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7921:x1874700152101120:12345-0@lo:7: 00002000:00080000:3.0:1787853491.144431:0:6673:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1787853491.144441:0:6673:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787853491.144617:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775482d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7921:x1874700152101120:12345-0@lo:7: Request processed in 10655us (10820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853491.144630:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787853491.148712:0:7921:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992775481e00 x1874700152101120/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787853507 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853491.148734:0:7921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992775481e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7921:1874700152101120:0@lo:7: 00000004:00080000:2.0:1787853491.148756:0:7921:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787853491.148965:0:7921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5ed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7921:1874700152101248:0@lo:5: 00000100:00100000:3.0:1787853491.149046:0:7921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853491.149114:0:7921:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276e832180 going to sleep for 11 seconds 00000100:00100000:0.0:1787853491.152099:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152101248 00000100:00100000:0.0:1787853491.152118:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152101248 00000100:00100000:0.0:1787853491.152193:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787853491.152204:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7921:x1874700152101248:12345-0@lo:5: 00002000:00080000:0.0:1787853491.152254:0:6671:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787853491.152258:0:6671:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787853491.152787:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7921:x1874700152101248:12345-0@lo:5: Request processed in 583us (3739us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787853491.152796:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787853491.153042:0:7921:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992748f5ed00 x1874700152101248/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787853507 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853491.153063:0:7921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5ed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7921:1874700152101248:0@lo:5: 00000004:00080000:2.0:1787853491.153079:0:7921:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787853491.153126:0:7921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992775481e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7921:1874700152101376:0@lo:700: 00000100:00100000:2.0:1787853491.153168:0:7921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853491.153213:0:7921:0:(client.c:2715:ptlrpc_set_wait()) set ffff992748fb2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787853491.153479:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152101376 00000100:00100000:1.0:1787853491.153486:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152101376 00000100:00100000:1.0:1787853491.153527:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787853491.153535:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775481680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7921:x1874700152101376:12345-0@lo:700: 00000100:00100000:1.0:1787853491.153571:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6679:1874700152101504:0@lo:700: 00000100:00100000:1.0:1787853491.153602:0:6679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853491.153626:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927460533c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853491.153749:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152101504 00000100:00100000:2.0:1787853491.153753:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152101504 00000100:00100000:2.0:1787853491.153785:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787853491.153792:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6679:x1874700152101504:12345-0@lo:700: 40000000:02000000:2.0:1787853491.195953:0:5831:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1787853491.211314:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6679:x1874700152101504:12345-0@lo:700: Request processed in 57510us (57699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853491.211332:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787853491.211415:0:6679:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992761e68f00 x1874700152101504/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787853507 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853491.211434:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6679:1874700152101504:0@lo:700: 40000000:02000000:2.0:1787853491.211449:0:6679:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1787853491.264563:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1787853491.264595:0:7622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787853491.266734:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775481680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7921:x1874700152101376:12345-0@lo:700: Request processed in 113192us (113558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853491.266752:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787853491.266783:0:7921:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992775481e00 x1874700152101376/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787853507 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853491.266800:0:7921:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787853491.266825:0:7921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992775481e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7921:1874700152101376:0@lo:700: 00000004:02000040:2.0:1787853491.312458:0:7921:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1787853491.318069:0:7921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992775481e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7921:1874700152101632:0@lo:5: 00000100:00100000:2.0:1787853491.318159:0:7921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853491.318296:0:7921:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274586f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853491.318903:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152101632 00000100:00100000:3.0:1787853491.318912:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152101632 00000100:00100000:3.0:1787853491.318973:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787853491.318984:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775483840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7921:x1874700152101632:12345-0@lo:5: 00002000:00080000:2.0:1787853491.330475:0:6673:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787853491.330572:0:6673:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1787853491.339507:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775483840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7921:x1874700152101632:12345-0@lo:5: Request processed in 20519us (21343us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787853491.339520:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787853491.339807:0:7921:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992775481e00 x1874700152101632/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787853507 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853491.339832:0:7921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992775481e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7921:1874700152101632:0@lo:5: 00000004:00080000:3.0:1787853491.339852:0:7921:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:1.0:1787853491.539954:0:7971:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787853492.103640:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853493.136034:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853494.086989:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152101760:0@lo:13: 00000100:00100000:3.0:1787853494.087062:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853494.087367:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152101760 00000100:00100000:1.0:1787853494.087375:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152101760 00000100:00100000:1.0:1787853494.087446:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787853494.087471:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152101760:12345-0@lo:13: 00002000:00000024:1.0:1787853494.087506:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853494.087572:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152101760:12345-0@lo:13: Request processed in 106us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853494.087580:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787853494.087655:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992761e68780 x1874700152101760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787853494.087664:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853494.087747:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152101760:0@lo:13: 00010000:00010000:0.0:1787853494.149893:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853495.174398:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853496.134413:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152101888:0@lo:400: 00000100:00100000:0.0:1787853496.134636:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853496.134928:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c200f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152102400:0@lo:400: 00000100:00100000:0.0:1787853496.134957:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853496.134986:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787853496.134992:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152102016:0@lo:400: 00000100:00100000:0.0:1787853496.135012:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853496.135032:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c203c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152102528:0@lo:400: 00000100:00100000:0.0:1787853496.135056:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853496.135082:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152102144:0@lo:400: 00000100:00100000:0.0:1787853496.135106:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853496.135128:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152102656:0@lo:13: 00000100:00100000:0.0:1787853496.135160:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853496.135180:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853496.135185:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992760d7cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152102272:0@lo:400: 00000100:00100000:0.0:1787853496.135204:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853496.135234:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152102400 00000100:00100000:0.0:1787853496.135240:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152102400 00000100:00100000:0.0:1787853496.135285:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152102016 00000100:00100000:0.0:1787853496.135288:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152102016 00000100:00100000:0.0:1787853496.135299:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152102144 00000100:00100000:0.0:1787853496.135301:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152102144 00000100:00100000:0.0:1787853496.135316:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787853496.135324:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152102400:12345-0@lo:400: 00000100:00100000:3.0:1787853496.135699:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787853496.135709:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152102016:12345-0@lo:400: 00000100:00100000:1.0:1787853496.135816:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152101888 00000100:00100000:1.0:1787853496.135821:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152101888 00000100:00100000:1.0:1787853496.135861:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787853496.135868:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152101888:12345-0@lo:400: 00000100:00100000:3.0:1787853496.137308:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152102016:12345-0@lo:400: Request processed in 1596us (2289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853496.137318:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787853496.137926:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152102400:12345-0@lo:400: Request processed in 2600us (2965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853496.137934:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787853496.137973:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787853496.137983:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152102144:12345-0@lo:400: 00000100:00100000:0.0:1787853496.138144:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152102144:12345-0@lo:400: Request processed in 164us (3036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853496.138151:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787853496.138172:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152102528 00000100:00100000:0.0:1787853496.138178:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152102528 00000100:00100000:0.0:1787853496.138217:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152102272 00000100:00100000:0.0:1787853496.138221:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152102272 00000100:00100000:0.0:1787853496.138237:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787853496.138243:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1874700152102528:12345-0@lo:400: 00000100:00100000:0.0:1787853496.138277:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1874700152102528:12345-0@lo:400: Request processed in 34us (3220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853496.138283:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787853496.138294:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787853496.138300:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274368a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152102272:12345-0@lo:400: 00000100:00100000:0.0:1787853496.138338:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274368a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152102272:12345-0@lo:400: Request processed in 28us (3122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853496.138345:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787853496.138574:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152102656 00000100:00100000:0.0:1787853496.138579:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152102656 00000100:00100000:0.0:1787853496.138607:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787853496.138613:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743688780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1874700152102656:12345-0@lo:13: 00002000:00000024:0.0:1787853496.138637:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853496.138669:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743688780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1874700152102656:12345-0@lo:13: Request processed in 56us (3508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853496.138694:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787853496.138720:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787853496.138724:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787853496.138726:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787853496.138830:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992761e68f00 x1874700152102016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853496.138854:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152102016:0@lo:400: 00010000:00080000:0.0:1787853496.138871:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277c203c00 x1874700152102528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853496.138881:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c203c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152102528:0@lo:400: 00010000:00080000:0.0:1787853496.138893:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277c200f00 x1874700152102400/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853496.138901:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c200f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152102400:0@lo:400: 00000100:00100000:1.0:1787853496.139224:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152101888:12345-0@lo:400: Request processed in 3355us (4587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853496.139233:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787853496.139624:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152101888:0@lo:400: 00010000:00080000:2.0:1787853496.139744:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992761e6b0c0 x1874700152102144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853496.139755:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152102144:0@lo:400: 00010000:00080000:2.0:1787853496.139832:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992748f5fc00 x1874700152102656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853496.139856:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152102656:0@lo:13: 00010000:00080000:2.0:1787853496.139883:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992760d7cb40 x1874700152102272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853496.139892:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992760d7cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152102272:0@lo:400: 00010000:00010000:0.0:1787853496.203296:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787853496.440166:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1787853497.224372:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853497.916875:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853497.917017:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136350080 00000100:00100000:0.0:1787853497.917030:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136350080 00000100:00100000:0.0:1787853497.917097:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 113 00000100:00100000:0.0:1787853497.917106:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2361:x1874700136350080:12345-192.168.206.10@tcp:250: 00010000:00080000:0.0:1787853497.917143:0:5819:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from c7076e8b-41d6-499a-b764-6185164c5ac6@192.168.206.10@tcp t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:0.0:1787853497.917178:0:5819:0:(genops.c:1385:class_connect()) connect: client c7076e8b-41d6-499a-b764-6185164c5ac6, cookie 0xcf1365f7cb05481e 00000100:00080000:0.0:1787853497.917364:0:5819:0:(import.c:65:import_set_state_nolock()) ffff992642911000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853497.917473:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+5:2361:x1874700136350080:12345-192.168.206.10@tcp:250: Request processed in 367us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853497.917481:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 113 00000100:00100000:0.0:1787853497.922756:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853497.923386:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136349952 00000100:00100000:1.0:1787853497.923399:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136349952 00000100:00100000:1.0:1787853497.923718:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 114 00000100:00100000:1.0:1787853497.923731:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+5:5588:x1874700136349952:12345-192.168.206.10@tcp:101: 00010000:00010000:1.0:1787853497.923754:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853497.923777:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927429f7a00/0xcf1365f7cb054825 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1e41 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853497.923813:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927429f7a00/0xcf1365f7cb054825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e41 expref: 6 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853497.923826:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927429f7a00/0xcf1365f7cb054825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e41 expref: 6 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853497.924023:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927429f7a00, rc 0) 00000100:00100000:1.0:1787853497.924154:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+6:5588:x1874700136349952:12345-192.168.206.10@tcp:101: Request processed in 427us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853497.924162:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 114 00000100:00100000:3.0:1787853497.943954:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853497.944089:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136350208 00000100:00100000:2.0:1787853497.944103:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136350208 00000100:00100000:2.0:1787853497.944177:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 115 00000100:00100000:2.0:1787853497.944188:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+6:5588:x1874700136350208:12345-192.168.206.10@tcp:501: 00000100:00100000:2.0:1787853497.944944:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+6:5588:x1874700136350208:12345-192.168.206.10@tcp:501: Request processed in 752us (998us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787853497.944955:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 115 00000100:00100000:0.0:1787853497.947618:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853497.947733:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136350336 00000100:00100000:1.0:1787853497.947745:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136350336 00000100:00100000:1.0:1787853497.947811:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 116 00000100:00100000:1.0:1787853497.947821:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+6:5588:x1874700136350336:12345-192.168.206.10@tcp:101: 00010000:00010000:1.0:1787853497.947854:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853497.947877:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb05482c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1e48 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853497.947911:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb05482c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e48 expref: 7 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853497.947924:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb05482c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e48 expref: 7 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853497.947935:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927429f7c00, rc 0) 00000100:00100000:1.0:1787853497.948005:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+7:5588:x1874700136350336:12345-192.168.206.10@tcp:101: Request processed in 185us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853497.948013:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 116 00000100:00100000:0.0:1787853497.950974:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853497.952515:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136350464 00000100:00100000:2.0:1787853497.952537:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136350464 00000100:00100000:2.0:1787853497.952623:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 117 00000100:00100000:2.0:1787853497.952634:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+7:5588:x1874700136350464:12345-192.168.206.10@tcp:501: 00000100:00100000:2.0:1787853497.953057:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+8:5588:x1874700136350464:12345-192.168.206.10@tcp:501: Request processed in 423us (2094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853497.953066:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 117 00000100:00100000:3.0:1787853497.959903:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853497.960107:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136350592 00000100:00100000:0.0:1787853497.960120:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136350592 00000100:00100000:0.0:1787853497.960186:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 118 00000100:00100000:0.0:1787853497.960196:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+8:5588:x1874700136350592:12345-192.168.206.10@tcp:503: 00000100:00100000:0.0:1787853497.960710:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+8:5588:x1874700136350592:12345-192.168.206.10@tcp:503: Request processed in 477us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853497.960719:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 118 00000100:00100000:0.0:1787853497.963404:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853497.964046:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136350720 00000100:00100000:2.0:1787853497.964060:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136350720 00000100:00100000:2.0:1787853497.964133:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 119 00000100:00100000:2.0:1787853497.964144:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+8:5607:x1874700136350720:12345-192.168.206.10@tcp:502: 00000100:00100000:2.0:1787853497.964595:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+8:5607:x1874700136350720:12345-192.168.206.10@tcp:502: Request processed in 450us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853497.964604:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 119 00000100:00100000:3.0:1787853498.023247:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853498.024708:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136350848 00000100:00100000:2.0:1787853498.024727:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136350848 00000100:00100000:2.0:1787853498.024875:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 120 00000100:00100000:2.0:1787853498.024886:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+8:5607:x1874700136350848:12345-192.168.206.10@tcp:502: 00000100:00100000:2.0:1787853498.025218:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+8:5607:x1874700136350848:12345-192.168.206.10@tcp:502: Request processed in 333us (1983us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853498.025226:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 120 00000100:00100000:3.0:1787853498.037739:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853498.037909:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136350976 00000100:00100000:0.0:1787853498.037921:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136350976 00000100:00100000:0.0:1787853498.037995:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 121 00000100:00100000:0.0:1787853498.038006:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+8:5588:x1874700136350976:12345-192.168.206.10@tcp:101: 00010000:00010000:0.0:1787853498.038027:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853498.038048:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927821c6c00/0xcf1365f7cb054833 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1e72 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853498.038084:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927821c6c00/0xcf1365f7cb054833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e72 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853498.038096:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927821c6c00/0xcf1365f7cb054833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e72 expref: 9 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853498.038107:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927821c6c00, rc 0) 00000100:00100000:0.0:1787853498.038177:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+9:5588:x1874700136350976:12345-192.168.206.10@tcp:101: Request processed in 172us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853498.038184:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 121 00000100:00100000:0.0:1787853498.044066:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853498.044344:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136351104 00000100:00100000:2.0:1787853498.044359:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136351104 00000100:00100000:2.0:1787853498.044438:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 122 00000100:00100000:2.0:1787853498.044524:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+9:5588:x1874700136351104:12345-192.168.206.10@tcp:256: 20000000:01000000:2.0:1787853498.044562:0:5816:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787853498.044612:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787853498.044618:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787853498.044622:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787853498.044624:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787853498.055384:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+9:5588:x1874700136351104:12345-192.168.206.10@tcp:256: Request processed in 10843us (11312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853498.055404:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 122 00000100:00100000:3.0:1787853498.059893:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853498.060057:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136351232 00000100:00100000:1.0:1787853498.060069:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136351232 00000100:00100000:1.0:1787853498.060141:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 123 00000100:00100000:1.0:1787853498.060153:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+9:5588:x1874700136351232:12345-192.168.206.10@tcp:101: 00010000:00010000:1.0:1787853498.060173:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853498.060197:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927429f6200/0xcf1365f7cb05483a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1e79 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853498.060257:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927429f6200/0xcf1365f7cb05483a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e79 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853498.060269:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927429f6200/0xcf1365f7cb05483a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e79 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853498.060280:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927429f6200, rc 0) 00000100:00100000:1.0:1787853498.060355:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+10:5588:x1874700136351232:12345-192.168.206.10@tcp:101: Request processed in 203us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853498.060374:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 123 00000100:00100000:0.0:1787853498.067730:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853498.070926:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136351360 00000100:00100000:2.0:1787853498.070948:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136351360 00000100:00100000:2.0:1787853498.071047:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 124 00000100:00100000:2.0:1787853498.071058:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992758772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+10:5588:x1874700136351360:12345-192.168.206.10@tcp:501: 00000100:00100000:2.0:1787853498.071450:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992758772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+10:5588:x1874700136351360:12345-192.168.206.10@tcp:501: Request processed in 392us (3779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853498.071459:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 124 00000100:00100000:3.0:1787853498.090630:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853498.091028:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136351488 00000100:00100000:0.0:1787853498.091042:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136351488 00000100:00100000:0.0:1787853498.091114:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 125 00000100:00100000:0.0:1787853498.091125:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992758771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+10:5588:x1874700136351488:12345-192.168.206.10@tcp:503: 00000100:00100000:0.0:1787853498.091938:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992758771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+10:5588:x1874700136351488:12345-192.168.206.10@tcp:503: Request processed in 808us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853498.091949:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 125 00000100:00100000:3.0:1787853498.099271:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853498.101541:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136351616 00000100:00100000:1.0:1787853498.101569:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136351616 00000100:00100000:1.0:1787853498.101659:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 126 00000100:00100000:1.0:1787853498.101717:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+10:5611:x1874700136351616:12345-192.168.206.10@tcp:502: 00000100:00100000:1.0:1787853498.102106:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+10:5611:x1874700136351616:12345-192.168.206.10@tcp:502: Request processed in 437us (2851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853498.102115:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 126 00000100:00100000:1.0:1787853498.105272:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853498.105516:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136351744 00000100:00100000:2.0:1787853498.105528:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136351744 00000100:00100000:2.0:1787853498.105649:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 127 00000100:00100000:2.0:1787853498.105661:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+10:5611:x1874700136351744:12345-192.168.206.10@tcp:502: 00000100:00100000:2.0:1787853498.106489:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+10:5611:x1874700136351744:12345-192.168.206.10@tcp:502: Request processed in 828us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853498.106500:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 127 00000100:00100000:3.0:1787853498.114972:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853498.115509:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136351872 00000100:00100000:2.0:1787853498.115522:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136351872 00000100:00100000:2.0:1787853498.115587:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:2.0:1787853498.115596:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2361:x1874700136351872:12345-192.168.206.10@tcp:38: 00010000:00080000:2.0:1787853498.115633:0:5826:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from 0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:2.0:1787853498.115740:0:5826:0:(genops.c:1385:class_connect()) connect: client 0d6ecd6d-a011-4e2a-a67c-6551aba162fe, cookie 0xcf1365f7cb054841 00000004:00100000:2.0:1787853498.116482:0:5826:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787853498.116556:0:5826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787853498.178259:0:5826:0:(import.c:65:import_set_state_nolock()) ffff99277bee4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787853498.178379:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2361:x1874700136351872:12345-192.168.206.10@tcp:38: Request processed in 62781us (63420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853498.178392:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00010000:00010000:0.0:1787853498.248560:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853499.185977:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853499.186027:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853499.186098:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136352000 00000100:00100000:1.0:1787853499.186110:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136352000 00000100:00100000:1.0:1787853499.186199:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136352128 00000100:00100000:1.0:1787853499.186203:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136352128 00000100:00100000:1.0:1787853499.186226:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:1.0:1787853499.186237:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:0:x1874700136352000:12345-192.168.206.10@tcp:41: 00000100:00100000:0.0:1787853499.186282:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:0.0:1787853499.186292:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:5588:x1874700136352128:12345-192.168.206.10@tcp:41: 00000004:00000024:1.0:1787853499.186295:0:5824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000004:00000024:0.0:1787853499.186307:0:5825:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787853499.186375:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:0:x1874700136352000:12345-192.168.206.10@tcp:41: Request processed in 140us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853499.186399:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00080000:2.0:1787853499.186446:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853499.195058:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:5588:x1874700136352128:12345-192.168.206.10@tcp:41: Request processed in 8600us (8863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853499.195077:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:1.0:1787853499.200500:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853499.201013:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136352256 00000100:00100000:3.0:1787853499.201028:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136352256 00000100:00100000:3.0:1787853499.201116:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:3.0:1787853499.201128:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:5588:x1874700136352256:12345-192.168.206.10@tcp:40: 00000100:00100000:3.0:1787853499.201240:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c200000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:5588:x1874700136352256:12345-192.168.206.10@tcp:40: Request processed in 114us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853499.201247:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:3.0:1787853499.204194:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853499.204241:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853499.204273:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853499.204543:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136352384 00000100:00100000:2.0:1787853499.204555:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136352384 00000100:00100000:2.0:1787853499.204603:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136352512 00000100:00100000:2.0:1787853499.204606:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136352512 00000100:00100000:2.0:1787853499.204624:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:2.0:1787853499.204634:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2361:x1874700136352384:12345-192.168.206.10@tcp:8: 00010000:00080000:2.0:1787853499.204717:0:6671:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:2.0:1787853499.204756:0:6671:0:(genops.c:1385:class_connect()) connect: client 0d6ecd6d-a011-4e2a-a67c-6551aba162fe, cookie 0xcf1365f7cb054848 00002000:00100000:2.0:1787853499.204771:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0d6ecd6d-a011-4e2a-a67c-6551aba162fe/ffff99277bee4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113953 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787853499.204820:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787853499.205274:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787853499.205313:0:6671:0:(import.c:65:import_set_state_nolock()) ffff99277bee1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787853499.205718:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136352640 00000100:00100000:1.0:1787853499.205725:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136352640 00000100:00100000:1.0:1787853499.205778:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:1.0:1787853499.205788:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:5588:x1874700136352640:12345-192.168.206.10@tcp:33: 00000100:00100000:3.0:1787853499.206796:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853499.206853:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136352768 00000100:00100000:3.0:1787853499.206859:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136352768 00000100:00100000:1.0:1787853499.207080:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c2012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152102784:0@lo:13: 00000100:00100000:1.0:1787853499.207164:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853499.207237:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152102784 00000100:00100000:1.0:1787853499.207241:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152102784 00000100:00100000:1.0:1787853499.207280:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787853499.207288:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c200b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152102784:12345-0@lo:13: 00002000:00000024:1.0:1787853499.207320:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853499.208056:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2361:x1874700136352384:12345-192.168.206.10@tcp:8: Request processed in 3417us (3871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853499.208067:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:3.0:1787853499.208175:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 128 00000100:00100000:3.0:1787853499.208191:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2365:x1874700136352768:12345-192.168.206.10@tcp:400: 00000100:00100000:3.0:1787853499.208223:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2365:x1874700136352768:12345-192.168.206.10@tcp:400: Request processed in 38us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853499.208230:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 128 00000100:00080000:3.0:1787853499.208314:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853499.208518:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c200b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152102784:12345-0@lo:13: Request processed in 1230us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853499.208527:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787853499.208576:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277c2012c0 x1874700152102784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853499.208601:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c2012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152102784:0@lo:13: 00000100:00100000:2.0:1787853499.215280:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:2.0:1787853499.216094:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2361:x1874700136352512:12345-192.168.206.10@tcp:8: 00010000:00080000:2.0:1787853499.216209:0:6671:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:2.0:1787853499.216253:0:6671:0:(genops.c:1385:class_connect()) connect: client 0d6ecd6d-a011-4e2a-a67c-6551aba162fe, cookie 0xcf1365f7cb05484f 00002000:00100000:2.0:1787853499.216270:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0d6ecd6d-a011-4e2a-a67c-6551aba162fe/ffff99277bee5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113953 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787853499.216875:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787853499.224955:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787853499.225018:0:6671:0:(import.c:65:import_set_state_nolock()) ffff99277bee1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787853499.225128:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2361:x1874700136352512:12345-192.168.206.10@tcp:8: Request processed in 9828us (20850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853499.225141:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000004:00080000:3.0:1787853499.247174:0:5827:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 41298us 00000004:00200000:3.0:1787853499.269900:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787853499.270268:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:5588:x1874700136352640:12345-192.168.206.10@tcp:33: Request processed in 64473us (66017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853499.270286:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00010000:00010000:3.0:1787853499.271080:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853499.446347:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853499.446616:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136352896 00000100:00100000:0.0:1787853499.446628:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136352896 00000100:00100000:0.0:1787853499.446737:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:0.0:1787853499.446748:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c2012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:5628:x1874700136352896:12345-192.168.206.10@tcp:101: 00010000:00010000:0.0:1787853499.446773:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853499.446956:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7c00/0xcf1365f7cb054856 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1ea3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853499.447040:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb05485d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853499.447072:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb05485d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853499.447090:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb05485d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853499.447289:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787853499.447294:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853499.447412:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb05485d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853499.447443:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7c00/0xcf1365f7cb054856 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ea3 expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853499.447462:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb05485d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ea3 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853499.447471:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992761dc9900) 00010000:00010000:0.0:1787853499.447474:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787853499.447477:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927821c7800, rc 0) 00000100:00100000:0.0:1787853499.447557:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c2012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:5628:x1874700136352896:12345-192.168.206.10@tcp:101: Request processed in 810us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853499.447566:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00010000:00010000:0.0:1787853500.293888:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853501.254181:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152102912:0@lo:400: 00000100:00100000:2.0:1787853501.254182:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874700152103040:0@lo:400: 00000100:00100000:1.0:1787853501.254270:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152103168:0@lo:400: 00000100:00100000:2.0:1787853501.256956:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853501.257111:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152103552:0@lo:400: 00000100:00100000:2.0:1787853501.257166:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853501.257277:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152103296:0@lo:400: 00000100:00100000:2.0:1787853501.257309:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853501.257335:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787853501.257740:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152103680:0@lo:13: 00000100:00100000:2.0:1787853501.257775:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853501.257921:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152103680 00000100:00100000:2.0:1787853501.257931:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152103680 00000100:00100000:2.0:1787853501.257997:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787853501.258008:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152103680:12345-0@lo:13: 00002000:00000024:2.0:1787853501.258053:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853501.258103:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152103680:12345-0@lo:13: Request processed in 98us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853501.258111:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787853501.258137:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152103552 00000100:00100000:2.0:1787853501.258141:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152103552 00000100:00100000:2.0:1787853501.258163:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152103296 00000100:00100000:2.0:1787853501.258167:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152103296 00000100:00100000:2.0:1787853501.258184:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787853501.258191:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927754830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152103552:12345-0@lo:400: 00000100:00100000:2.0:1787853501.258234:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927754830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152103552:12345-0@lo:400: Request processed in 44us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853501.258240:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787853501.258251:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787853501.258257:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775481a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152103296:12345-0@lo:400: 00000100:00100000:2.0:1787853501.258287:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775481a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152103296:12345-0@lo:400: Request processed in 30us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853501.258294:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787853501.258335:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99276dac3480 x1874700152103680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853501.258359:0:3298:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787853501.258547:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152103680:0@lo:13: 00010000:00080000:2.0:1787853501.258576:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992748f5f0c0 x1874700152103296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853501.258779:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152103296:0@lo:400: 00010000:00080000:2.0:1787853501.258846:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99276dac3c00 x1874700152103552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853501.258857:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152103552:0@lo:400: 00000100:00080000:2.0:1787853501.258892:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787853501.258897:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787853501.259217:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152103040 00000100:00100000:3.0:1787853501.259224:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152103040 00000100:00100000:3.0:1787853501.259277:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787853501.259286:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927754812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874700152103040:12345-0@lo:400: 00000100:00100000:3.0:1787853501.259737:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927754812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874700152103040:12345-0@lo:400: Request processed in 450us (2790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853501.259744:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787853501.259875:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874700152103040:0@lo:400: 00000100:00100000:1.0:1787853501.260198:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853501.260663:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152103168 00000100:00100000:3.0:1787853501.260670:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152103168 00000100:00100000:0.0:1787853501.260928:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853501.260989:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152103424:0@lo:400: 00000100:00100000:0.0:1787853501.261035:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853501.261096:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152103424 00000100:00100000:0.0:1787853501.261101:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152103424 00000100:00100000:1.0:1787853501.261157:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152102912 00000100:00100000:1.0:1787853501.261162:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152102912 00000100:00100000:1.0:1787853501.261208:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787853501.261226:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152102912:12345-0@lo:400: 00000100:00100000:1.0:1787853501.261291:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152102912:12345-0@lo:400: Request processed in 68us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853501.261299:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787853501.261385:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152102912:0@lo:400: 00000100:00100000:3.0:1787853501.266139:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787853501.266165:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c202580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152103168:12345-0@lo:400: 00000100:00100000:3.0:1787853501.266304:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c202580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152103168:12345-0@lo:400: Request processed in 150us (6106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853501.266312:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787853501.267142:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152103168:0@lo:400: 00000100:00100000:0.0:1787853501.271848:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787853501.271869:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743689a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152103424:12345-0@lo:400: 00000100:00100000:0.0:1787853501.272009:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743689a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152103424:12345-0@lo:400: Request processed in 147us (10973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853501.272017:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787853501.272938:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853501.273092:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152103424:0@lo:400: 00010000:00010000:1.0:1787853501.319591:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853501.536473:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853501.536601:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136353024 00000100:00100000:3.0:1787853501.536613:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136353024 00000100:00100000:3.0:1787853501.536754:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:3.0:1787853501.536767:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c2021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:5680:x1874700136353024:12345-192.168.206.10@tcp:41: 00000004:00000024:3.0:1787853501.536834:0:5825:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:2.0:1787853501.536945:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853501.536953:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c2021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:5680:x1874700136353024:12345-192.168.206.10@tcp:41: Request processed in 188us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853501.536962:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:3.0:1787853501.551008:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853501.551397:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136353152 00000100:00100000:2.0:1787853501.551412:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136353152 00000100:00080000:3.0:1787853501.551489:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853501.551511:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:2.0:1787853501.551523:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:5680:x1874700136353152:12345-192.168.206.10@tcp:13: 00002000:00000024:2.0:1787853501.551572:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853501.551830:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:5680:x1874700136353152:12345-192.168.206.10@tcp:13: Request processed in 308us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853501.551839:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:0.0:1787853501.554300:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853501.554872:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136353280 00000100:00100000:1.0:1787853501.554885:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136353280 00000100:00100000:1.0:1787853501.554982:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:1.0:1787853501.554992:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927436883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:5680:x1874700136353280:12345-192.168.206.10@tcp:13: 00002000:00000024:1.0:1787853501.555025:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853501.555115:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927436883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:5680:x1874700136353280:12345-192.168.206.10@tcp:13: Request processed in 124us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853501.555124:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00080000:3.0:1787853501.555808:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787853502.354079:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787853502.862654:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0d6ecd6d-a011-4e2a-a67c-6551aba162fe 00000001:00100000:2.0:1787853502.881486:0:7622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0d6ecd6d-a011-4e2a-a67c-6551aba162fe 00000001:00100000:0.0:1787853503.350070:0:5846:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0d6ecd6d-a011-4e2a-a67c-6551aba162fe 00010000:00010000:2.0:1787853503.370996:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787853504.144493:0:8280:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1787853504.328105:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c203840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152103808:0@lo:13: 00000100:00100000:2.0:1787853504.328186:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853504.328387:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152103808 00000100:00100000:1.0:1787853504.328395:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152103808 00000100:00080000:3.0:1787853504.328495:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853504.328531:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787853504.328542:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152103808:12345-0@lo:13: 00002000:00000024:1.0:1787853504.328577:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853504.328636:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152103808:12345-0@lo:13: Request processed in 97us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853504.328661:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787853504.328757:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277c203840 x1874700152103808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853504.328778:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c203840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152103808:0@lo:13: 00010000:00010000:0.0:1787853504.390092:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853504.442334:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853504.442910:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853504.442951:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853504.442987:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853504.443534:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136353536 00000100:00100000:0.0:1787853504.443545:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136353536 00000100:00100000:0.0:1787853504.443626:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:0.0:1787853504.443637:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c202d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2365:x1874700136353536:12345-192.168.206.10@tcp:400: 00000100:00100000:0.0:1787853504.443754:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c202d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2365:x1874700136353536:12345-192.168.206.10@tcp:400: Request processed in 118us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853504.443762:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:2.0:1787853504.443950:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136353408 00000100:00100000:2.0:1787853504.443955:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136353408 00000100:00100000:2.0:1787853504.443989:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 130 00000100:00100000:2.0:1787853504.443996:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2365:x1874700136353408:12345-192.168.206.10@tcp:400: 00000100:00100000:2.0:1787853504.444042:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2365:x1874700136353408:12345-192.168.206.10@tcp:400: Request processed in 47us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853504.444049:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 130 00000100:00100000:2.0:1787853504.444076:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136353664 00000100:00100000:2.0:1787853504.444079:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136353664 00000100:00100000:2.0:1787853504.444104:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136353792 00000100:00100000:2.0:1787853504.444107:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136353792 00000100:00100000:2.0:1787853504.444121:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:2.0:1787853504.444127:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c201680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136353664:12345-192.168.206.10@tcp:400: 00000100:00100000:2.0:1787853504.444152:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c201680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136353664:12345-192.168.206.10@tcp:400: Request processed in 25us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853504.444159:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:2.0:1787853504.444174:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:2.0:1787853504.444180:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c201e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136353792:12345-192.168.206.10@tcp:400: 00000100:00100000:2.0:1787853504.444204:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c201e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136353792:12345-192.168.206.10@tcp:400: Request processed in 24us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853504.444210:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00080000:1.0:1787853504.444477:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787853504.444481:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787853504.444483:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787853505.416512:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853506.375154:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152104192:0@lo:400: 00000100:00100000:3.0:1787853506.375223:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853506.375285:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853506.375292:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152104320:0@lo:400: 00000100:00100000:3.0:1787853506.375315:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853506.375352:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152104192 00000100:00100000:3.0:1787853506.375363:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152104192 00000100:00100000:1.0:1787853506.375474:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152103936:0@lo:400: 00000100:00100000:1.0:1787853506.375514:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853506.375546:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152104448:0@lo:400: 00000100:00100000:1.0:1787853506.375572:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853506.375592:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787853506.375598:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152104064:0@lo:400: 00000100:00100000:1.0:1787853506.375622:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853506.375642:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152104576:0@lo:400: 00000100:00100000:1.0:1787853506.375668:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853506.375725:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152103936 00000100:00100000:1.0:1787853506.375729:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152103936 00000100:00100000:1.0:1787853506.375771:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787853506.375782:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152103936:12345-0@lo:400: 00000100:00100000:1.0:1787853506.375851:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152103936:12345-0@lo:400: Request processed in 72us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853506.375859:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787853506.375893:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152104448 00000100:00100000:1.0:1787853506.375897:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152104448 00000100:00100000:2.0:1787853506.376013:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787853506.376023:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992775481e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152104704:0@lo:13: 00000100:00100000:2.0:1787853506.376051:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853506.376078:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152104704 00000100:00100000:2.0:1787853506.376082:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152104704 00000100:00100000:2.0:1787853506.376121:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787853506.376130:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152104704:12345-0@lo:13: 00002000:00000024:2.0:1787853506.376160:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853506.376209:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152104704:12345-0@lo:13: Request processed in 81us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853506.376217:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787853506.376252:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992775481e00 x1874700152104704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853506.376271:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992775481e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152104704:0@lo:13: 00000100:00100000:3.0:1787853506.376539:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152104064 00000100:00100000:3.0:1787853506.376543:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152104064 00000100:00100000:0.0:1787853506.377082:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152104320 00000100:00100000:0.0:1787853506.377088:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152104320 00000100:00100000:0.0:1787853506.377119:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152104576 00000100:00100000:0.0:1787853506.377122:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152104576 00000100:00100000:0.0:1787853506.377138:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787853506.377145:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152104320:12345-0@lo:400: 00000100:00100000:0.0:1787853506.377200:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152104320:12345-0@lo:400: Request processed in 56us (1884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853506.377206:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787853506.377219:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787853506.377231:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c201a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152104576:12345-0@lo:400: 00000100:00100000:0.0:1787853506.377259:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c201a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152104576:12345-0@lo:400: Request processed in 29us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853506.377265:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787853506.377283:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787853506.380166:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787853506.380176:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c200780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152104448:12345-0@lo:400: 00000100:00100000:1.0:1787853506.380250:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c200780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152104448:12345-0@lo:400: Request processed in 75us (4677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853506.380256:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1787853506.380278:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787853506.380283:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853506.380285:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787853506.380326:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99276dac1680 x1874700152104576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853506.380340:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152104576:0@lo:400: 00000100:00100000:1.0:1787853506.380349:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152103936:0@lo:400: 00000100:00100000:1.0:1787853506.380372:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152104448:0@lo:400: 00010000:00080000:1.0:1787853506.380425:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99276dac30c0 x1874700152104320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853506.380434:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152104320:0@lo:400: 00000100:00100000:0.0:1787853506.382217:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152104192:12345-0@lo:400: 00000100:00100000:3.0:1787853506.382263:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787853506.382276:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c202940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152104064:12345-0@lo:400: 00000100:00100000:0.0:1787853506.382302:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152104192:12345-0@lo:400: Request processed in 5011us (7077us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853506.382311:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787853506.382331:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c202940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152104064:12345-0@lo:400: Request processed in 57us (6707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853506.382340:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787853506.382612:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152104192:0@lo:400: 00000100:00100000:3.0:1787853506.382711:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152104064:0@lo:400: 00010000:00010000:0.0:1787853506.437945:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853507.463541:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787853507.749097:0:8428:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe75609150 20000000:00000080:3.0:1787853507.749129:0:8428:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99276d49b800 uarg=0000000000000000 20000000:01000000:3.0:1787853507.749178:0:8428:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787853507.749181:0:8428:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787853507.749184:0:8428:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787853507.749191:0:8428:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787853507.749198:0:8428:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787853507.749216:0:8428:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787853507.749219:0:8428:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787853507.749443:0:8428:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787853507.749447:0:8428:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787853507.751608:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1787853507.752508:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1787853507.752568:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1787853507.752606:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1787853507.752621:0:8428:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787853507.752625:0:8428:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787853507.755549:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1787853507.756646:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1787853507.756815:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1787853507.756870:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1787853507.756889:0:8428:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787853507.756892:0:8428:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787853507.761000:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1787853507.761798:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1787853507.761874:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1787853507.761930:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1787853507.761945:0:8428:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787853507.761948:0:8428:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787853507.763908:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787853507.767927:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787853507.768019:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1787853507.768060:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:3.0:1787853507.768079:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787853507.768106:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99275064cc00/0xcf1365f7cb054864 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.768128:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff992747f71400/0xcf1365f7cb054761 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05475a expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.768137:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99275064d600/0xcf1365f7cb05478b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054784 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.768145:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99275064c000/0xcf1365f7cb0547b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0547ae expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.768151:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99275064d800/0xcf1365f7cb0547c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0547bc expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.768168:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff992747f71e00/0xcf1365f7cb0547d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0547ca expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.768176:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff992747f70e00/0xcf1365f7cb0547ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0547e6 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.768183:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff992740031400/0xcf1365f7cb054817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054810 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.768193:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9927429f7a00/0xcf1365f7cb054825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e41 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.768201:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb05482c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e48 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.768209:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99275064cc00/0xcf1365f7cb054864 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.768261:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb05482c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e48 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.768283:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb05482c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e48 expref: 9 pid: 5818 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853507.768302:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac2580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1874700152104832:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787853507.768441:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9927429f7a00/0xcf1365f7cb054825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e41 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.768452:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9927429f7a00/0xcf1365f7cb054825 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e41 expref: 9 pid: 5818 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853507.768468:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac0780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1874700152104960:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787853507.768502:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff992740031400/0xcf1365f7cb054817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb054810 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.768511:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff992740031400/0xcf1365f7cb054817 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb054810 expref: 18 pid: 5816 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853507.768520:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac2940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1874700152105088:0@lo:104: 00000100:00100000:3.0:1787853507.773615:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787853507.773767:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff992747f70e00/0xcf1365f7cb0547ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb0547e6 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.773797:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff992747f70e00/0xcf1365f7cb0547ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb0547e6 expref: 18 pid: 5818 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853507.773818:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac03c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1874700152105216:0@lo:104: 00000100:00100000:3.0:1787853507.773882:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787853507.773913:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff992747f71e00/0xcf1365f7cb0547d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb0547ca expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.773923:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff992747f71e00/0xcf1365f7cb0547d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb0547ca expref: 18 pid: 5818 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853507.773932:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac0f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1874700152105344:0@lo:104: 00010000:00010000:3.0:1787853507.773960:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99275064d800/0xcf1365f7cb0547c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb0547bc expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.773968:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99275064d800/0xcf1365f7cb0547c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb0547bc expref: 18 pid: 5818 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853507.773999:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac21c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1874700152105472:0@lo:104: 00010000:00010000:3.0:1787853507.774029:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99275064c000/0xcf1365f7cb0547b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb0547ae expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.774036:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99275064c000/0xcf1365f7cb0547b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb0547ae expref: 18 pid: 5819 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853507.774044:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac30c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1874700152105600:0@lo:104: 00010000:00010000:3.0:1787853507.774067:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99275064d600/0xcf1365f7cb05478b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb054784 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.774075:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99275064d600/0xcf1365f7cb05478b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb054784 expref: 18 pid: 5818 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853507.774082:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac3840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1874700152105728:0@lo:104: 00010000:00010000:3.0:1787853507.774102:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff992747f71400/0xcf1365f7cb054761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb05475a expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.774109:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff992747f71400/0xcf1365f7cb054761 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb05475a expref: 18 pid: 5819 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853507.774116:0:8428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac12c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1874700152105856:0@lo:104: 00000100:00100000:3.0:1787853507.774132:0:8428:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c096180 going to sleep for 11 seconds 00000100:00100000:2.0:1787853507.774322:0:5807:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787853507.774349:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853507.774363:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853507.774371:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853507.774380:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853507.774389:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853507.774399:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152105088 00000100:00100000:2.0:1787853507.774406:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152105088 00000100:00100000:2.0:1787853507.774468:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152105216 00000100:00100000:2.0:1787853507.774471:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152105216 00000100:00100000:2.0:1787853507.774483:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152105344 00000100:00100000:2.0:1787853507.774486:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152105344 00000100:00100000:2.0:1787853507.774495:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152105472 00000100:00100000:2.0:1787853507.774497:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152105472 00000100:00100000:2.0:1787853507.774506:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152105600 00000100:00100000:2.0:1787853507.774508:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152105600 00000100:00100000:2.0:1787853507.774518:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152105728 00000100:00100000:2.0:1787853507.774520:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152105728 00000100:00100000:2.0:1787853507.774530:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152105856 00000100:00100000:2.0:1787853507.774532:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152105856 00000100:00100000:2.0:1787853507.774548:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787853507.774557:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+9:8428:x1874700152105088:12345-0@lo:104: 00010000:00010000:2.0:1787853507.774572:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb054810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054817 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.774660:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787853507.774667:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+9:8428:x1874700152105088:12345-0@lo:104: Request processed in 111us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853507.774697:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787853507.774717:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787853507.774724:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c27bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+8:8428:x1874700152105216:12345-0@lo:104: 00010000:00010000:2.0:1787853507.774732:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff992740030a00/0xcf1365f7cb0547e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0547ed expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.774766:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787853507.774771:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c27bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+8:8428:x1874700152105216:12345-0@lo:104: Request processed in 49us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853507.774776:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787853507.774833:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787853507.774840:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+7:8428:x1874700152105344:12345-0@lo:104: 00010000:00010000:2.0:1787853507.774847:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff992740031a00/0xcf1365f7cb0547ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0547d1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.774871:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787853507.774876:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+7:8428:x1874700152105344:12345-0@lo:104: Request processed in 38us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853507.774881:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787853507.774892:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787853507.774896:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+6:8428:x1874700152105472:12345-0@lo:104: 00010000:00010000:2.0:1787853507.774904:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff99275064c200/0xcf1365f7cb0547bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0547c3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.774935:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787853507.774940:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+6:8428:x1874700152105472:12345-0@lo:104: Request processed in 43us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853507.774946:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787853507.774957:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787853507.774962:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+5:8428:x1874700152105600:12345-0@lo:104: 00010000:00010000:2.0:1787853507.774969:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff99275064d400/0xcf1365f7cb0547ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0547b5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.774991:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787853507.774995:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+5:8428:x1874700152105600:12345-0@lo:104: Request processed in 34us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853507.775001:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787853507.775010:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787853507.775014:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+4:8428:x1874700152105728:12345-0@lo:104: 00010000:00010000:2.0:1787853507.775021:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff992740030400/0xcf1365f7cb054784 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb05478b expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775042:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1787853507.775047:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+4:8428:x1874700152105728:12345-0@lo:104: Request processed in 33us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853507.775051:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787853507.775060:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787853507.775065:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775481e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:8428:x1874700152105856:12345-0@lo:104: 00010000:00010000:2.0:1787853507.775072:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9927429f7000/0xcf1365f7cb05475a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054761 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775104:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1787853507.775109:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775481e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:8428:x1874700152105856:12345-0@lo:104: Request processed in 44us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853507.775116:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787853507.775154:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1787853507.775161:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb054810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054817 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775169:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740030600 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1787853507.775174:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb054810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb054817 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775183:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb054810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb054817 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853507.775190:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb054810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb054817 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853507.775196:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787853507.775231:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb054810 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054817 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775237:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853507.775259:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb054810 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054817 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775266:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff992740030600/0xcf1365f7cb054810 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054817 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775292:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787853507.775295:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff992740030a00/0xcf1365f7cb0547e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0547ed expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775301:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740030a00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1787853507.775304:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff992740030a00/0xcf1365f7cb0547e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb0547ed expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775311:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff992740030a00/0xcf1365f7cb0547e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb0547ed expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853507.775318:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff992740030a00/0xcf1365f7cb0547e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb0547ed expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853507.775323:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787853507.775337:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff992740030a00/0xcf1365f7cb0547e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0547ed expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775342:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853507.775357:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff992740030a00/0xcf1365f7cb0547e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0547ed expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775363:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff992740030a00/0xcf1365f7cb0547e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0547ed expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775373:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787853507.775376:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff992740031a00/0xcf1365f7cb0547ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0547d1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775392:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031a00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1787853507.775395:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff992740031a00/0xcf1365f7cb0547ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb0547d1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775401:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff992740031a00/0xcf1365f7cb0547ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb0547d1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853507.775407:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff992740031a00/0xcf1365f7cb0547ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb0547d1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853507.775412:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787853507.775426:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff992740031a00/0xcf1365f7cb0547ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0547d1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775432:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853507.775438:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff992740031a00/0xcf1365f7cb0547ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0547d1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775444:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff992740031a00/0xcf1365f7cb0547ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0547d1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775453:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787853507.775456:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff99275064c200/0xcf1365f7cb0547bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0547c3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775461:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064c200 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1787853507.775464:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff99275064c200/0xcf1365f7cb0547bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb0547c3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775481:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff99275064c200/0xcf1365f7cb0547bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb0547c3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853507.775487:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff99275064c200/0xcf1365f7cb0547bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb0547c3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853507.775493:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787853507.775506:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff99275064c200/0xcf1365f7cb0547bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0547c3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775512:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853507.775517:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff99275064c200/0xcf1365f7cb0547bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0547c3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775524:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff99275064c200/0xcf1365f7cb0547bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0547c3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775534:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787853507.775537:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff99275064d400/0xcf1365f7cb0547ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0547b5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775542:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d400 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1787853507.775544:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff99275064d400/0xcf1365f7cb0547ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb0547b5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775551:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff99275064d400/0xcf1365f7cb0547ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb0547b5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853507.775557:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff99275064d400/0xcf1365f7cb0547ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb0547b5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853507.775569:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787853507.775584:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff99275064d400/0xcf1365f7cb0547ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0547b5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775589:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853507.775593:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff99275064d400/0xcf1365f7cb0547ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0547b5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775600:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff99275064d400/0xcf1365f7cb0547ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0547b5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775610:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853507.775613:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff992740030400/0xcf1365f7cb054784 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb05478b expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775618:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740030400 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1787853507.775621:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff992740030400/0xcf1365f7cb054784 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb05478b expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775628:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff992740030400/0xcf1365f7cb054784 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb05478b expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853507.775634:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff992740030400/0xcf1365f7cb054784 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb05478b expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853507.775639:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787853507.775650:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff992740030400/0xcf1365f7cb054784 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb05478b expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775656:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853507.775668:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff992740030400/0xcf1365f7cb054784 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb05478b expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775700:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff992740030400/0xcf1365f7cb054784 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb05478b expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775710:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853507.775713:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9927429f7000/0xcf1365f7cb05475a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054761 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775718:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927429f7000 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1787853507.775721:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9927429f7000/0xcf1365f7cb05475a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb054761 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775727:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9927429f7000/0xcf1365f7cb05475a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb054761 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853507.775733:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9927429f7000/0xcf1365f7cb05475a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb054761 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853507.775738:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787853507.775751:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9927429f7000/0xcf1365f7cb05475a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054761 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775757:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853507.775760:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9927429f7000/0xcf1365f7cb05475a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054761 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775766:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9927429f7000/0xcf1365f7cb05475a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054761 expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.775793:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853507.775801:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853507.775803:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853507.775814:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853507.775840:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152105984:0@lo:103: 00000100:00100000:2.0:1787853507.775890:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853507.775921:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992760d7d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152106496:0@lo:103: 00000100:00100000:2.0:1787853507.775944:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853507.775978:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787853507.775984:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152106368:0@lo:103: 00000100:00100000:2.0:1787853507.776006:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853507.776040:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152106112:0@lo:103: 00000100:00100000:2.0:1787853507.776066:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853507.776076:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992760d7cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152106624:0@lo:103: 00000100:00100000:2.0:1787853507.776096:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853507.776108:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787853507.776113:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152106240:0@lo:103: 00000100:00100000:2.0:1787853507.776159:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853507.776170:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152106752:0@lo:103: 00000100:00100000:2.0:1787853507.776192:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853507.776223:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152105984 00000100:00100000:2.0:1787853507.776230:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152105984 00010000:00010000:2.0:1787853507.776264:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff992740031400/0xcf1365f7cb054817 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb054810 expref: 19 pid: 5816 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853507.776287:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152106496 00000100:00100000:2.0:1787853507.776290:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152106496 00010000:00010000:2.0:1787853507.776302:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99275064c000/0xcf1365f7cb0547b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0547ae expref: 20 pid: 5819 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853507.776327:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152106368 00000100:00100000:2.0:1787853507.776330:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152106368 00010000:00010000:2.0:1787853507.776343:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99275064d800/0xcf1365f7cb0547c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0547bc expref: 21 pid: 5818 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853507.776352:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152106112 00000100:00100000:2.0:1787853507.776354:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152106112 00010000:00010000:2.0:1787853507.776365:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff992747f70e00/0xcf1365f7cb0547ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0547e6 expref: 22 pid: 5818 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853507.776375:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152106624 00000100:00100000:2.0:1787853507.776377:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152106624 00010000:00010000:2.0:1787853507.776387:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99275064d600/0xcf1365f7cb05478b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb054784 expref: 23 pid: 5818 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853507.776397:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152106240 00000100:00100000:2.0:1787853507.776400:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152106240 00010000:00010000:2.0:1787853507.776410:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff992747f71e00/0xcf1365f7cb0547d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0547ca expref: 24 pid: 5818 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853507.776419:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152106752 00000100:00100000:2.0:1787853507.776422:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152106752 00010000:00010000:2.0:1787853507.776431:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff992747f71400/0xcf1365f7cb054761 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb05475a expref: 25 pid: 5819 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853507.776444:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787853507.776453:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+25:3298:x1874700152105984:12345-0@lo:103: 00010000:00010000:2.0:1787853507.776466:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853507.776473:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff992740031400/0xcf1365f7cb054817 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb054810 expref: 25 pid: 5816 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.776496:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff992740031400/0xcf1365f7cb054817 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb054810 expref: 25 pid: 5816 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.776518:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853507.776555:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+25:3298:x1874700152105984:12345-0@lo:103: Request processed in 103us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853507.776563:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787853507.776580:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787853507.776587:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761eabc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+24:3298:x1874700152106496:12345-0@lo:103: 00010000:00010000:2.0:1787853507.776595:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853507.776599:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99275064c000/0xcf1365f7cb0547b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0547ae expref: 24 pid: 5819 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.776606:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99275064c000/0xcf1365f7cb0547b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb0547ae expref: 24 pid: 5819 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.776616:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853507.776637:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761eabc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+24:3298:x1874700152106496:12345-0@lo:103: Request processed in 52us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853507.776644:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787853507.776656:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787853507.776662:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+23:3298:x1874700152106368:12345-0@lo:103: 00010000:00010000:2.0:1787853507.776699:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853507.776705:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99275064d800/0xcf1365f7cb0547c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0547bc expref: 23 pid: 5818 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.776712:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99275064d800/0xcf1365f7cb0547c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb0547bc expref: 23 pid: 5818 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.776728:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853507.776754:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+23:3298:x1874700152106368:12345-0@lo:103: Request processed in 91us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853507.776760:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787853507.776773:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787853507.776790:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761eab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+22:3299:x1874700152106112:12345-0@lo:103: 00010000:00010000:2.0:1787853507.776799:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853507.776803:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff992747f70e00/0xcf1365f7cb0547ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0547e6 expref: 22 pid: 5818 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.776812:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff992747f70e00/0xcf1365f7cb0547ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb0547e6 expref: 22 pid: 5818 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.776822:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853507.776850:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761eab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+22:3299:x1874700152106112:12345-0@lo:103: Request processed in 72us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853507.776856:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787853507.776869:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787853507.776875:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99275aa2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+21:3299:x1874700152106624:12345-0@lo:103: 00010000:00010000:2.0:1787853507.776883:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853507.776888:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99275064d600/0xcf1365f7cb05478b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb054784 expref: 21 pid: 5818 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.776896:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99275064d600/0xcf1365f7cb05478b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb054784 expref: 21 pid: 5818 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.776904:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853507.776933:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99275aa2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+21:3299:x1874700152106624:12345-0@lo:103: Request processed in 58us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853507.776939:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787853507.776953:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787853507.776960:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99275aa28b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+20:3299:x1874700152106240:12345-0@lo:103: 00010000:00010000:2.0:1787853507.776967:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853507.776971:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff992747f71e00/0xcf1365f7cb0547d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0547ca expref: 20 pid: 5818 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.776979:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff992747f71e00/0xcf1365f7cb0547d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb0547ca expref: 20 pid: 5818 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.776989:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853507.777011:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99275aa28b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+20:3299:x1874700152106240:12345-0@lo:103: Request processed in 52us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853507.777017:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787853507.777028:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787853507.777035:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274415f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152106752:12345-0@lo:103: 00010000:00010000:2.0:1787853507.777042:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853507.777047:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff992747f71400/0xcf1365f7cb054761 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb05475a expref: 19 pid: 5819 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.777055:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff992747f71400/0xcf1365f7cb054761 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb05475a expref: 19 pid: 5819 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.777064:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787853507.780481:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992740031400/0xcf1365f7cb054817 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb054810 expref: 19 pid: 5816 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853507.780510:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac2940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1874700152105088:0@lo:104: 00010000:00010000:3.0:1787853507.780527:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992747f70e00/0xcf1365f7cb0547ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb0547e6 expref: 18 pid: 5818 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853507.780561:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac03c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1874700152105216:0@lo:104: 00010000:00010000:3.0:1787853507.780578:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992747f71e00/0xcf1365f7cb0547d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb0547ca expref: 17 pid: 5818 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853507.780587:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac0f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1874700152105344:0@lo:104: 00010000:00010000:3.0:1787853507.780599:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99275064d800/0xcf1365f7cb0547c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb0547bc expref: 16 pid: 5818 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853507.780608:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac21c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1874700152105472:0@lo:104: 00010000:00010000:3.0:1787853507.780619:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99275064c000/0xcf1365f7cb0547b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb0547ae expref: 15 pid: 5819 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853507.780629:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac30c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1874700152105600:0@lo:104: 00010000:00010000:3.0:1787853507.780639:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99275064d600/0xcf1365f7cb05478b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb054784 expref: 14 pid: 5818 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853507.780647:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac3840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1874700152105728:0@lo:104: 00010000:00010000:3.0:1787853507.780659:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992747f71400/0xcf1365f7cb054761 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb05475a expref: 13 pid: 5819 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853507.780668:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac12c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1874700152105856:0@lo:104: 00000100:00100000:3.0:1787853507.782046:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152106368:0@lo:103: 00000100:00100000:3.0:1787853507.782065:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152105984:0@lo:103: 00000100:00100000:3.0:1787853507.782076:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992760d7d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152106496:0@lo:103: 00000100:00100000:0.0:1787853507.782436:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853507.782521:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853507.782573:0:5810:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787853507.782584:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787853507.783278:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac2580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1874700152104832:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787853507.783315:0:8428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac0780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1874700152104960:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787853507.783368:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99275064cc00/0xcf1365f7cb054864 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853507.786626:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274415f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152106752:12345-0@lo:103: Request processed in 50us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853507.786661:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787853507.787025:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152106240:0@lo:103: 00000100:00100000:2.0:1787853507.787039:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152106752:0@lo:103: 00000100:00100000:2.0:1787853507.787050:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152106112:0@lo:103: 00000100:00100000:2.0:1787853507.787059:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992760d7cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152106624:0@lo:103: 00000100:00100000:2.0:1787853507.787126:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136353920 00000100:00100000:2.0:1787853507.787134:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136353920 00010000:00010000:2.0:1787853507.787182:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb05482c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e48 expref: 10 pid: 5818 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853507.787204:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136354048 00000100:00100000:2.0:1787853507.787207:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136354048 00010000:00010000:2.0:1787853507.787220:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9927429f7a00/0xcf1365f7cb054825 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e41 expref: 11 pid: 5818 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853507.787238:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:2.0:1787853507.787249:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743688000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7076e8b-41d6-499a-b764-6185164c5ac6+11:2365:x1874700136353920:12345-192.168.206.10@tcp:103: 00010000:00010000:2.0:1787853507.787267:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853507.787274:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb05482c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e48 expref: 11 pid: 5818 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.787288:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb05482c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e48 expref: 11 pid: 5818 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.787312:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb05482c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e48 expref: 11 pid: 5818 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.787332:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853507.787419:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743688000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2365:x1874700136353920:12345-192.168.206.10@tcp:103: Request processed in 170us (4986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853507.787426:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:2.0:1787853507.787440:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:2.0:1787853507.787447:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927436892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7076e8b-41d6-499a-b764-6185164c5ac6+9:2365:x1874700136354048:12345-192.168.206.10@tcp:103: 00010000:00010000:2.0:1787853507.787456:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853507.787461:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9927429f7a00/0xcf1365f7cb054825 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e41 expref: 9 pid: 5818 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.787471:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9927429f7a00/0xcf1365f7cb054825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e41 expref: 9 pid: 5818 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.787482:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927429f7a00/0xcf1365f7cb054825 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e41 expref: 9 pid: 5818 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.787495:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99275064cc00/0xcf1365f7cb054864 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.787504:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99275064cc00/0xcf1365f7cb054864 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.787522:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99275064cc00/0xcf1365f7cb054864 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.787529:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99275064cc00/0xcf1365f7cb054864 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.787537:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99275064cc00/0xcf1365f7cb054864 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.787545:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99275064cc00/0xcf1365f7cb054864 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.787558:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064cc00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853507.787563:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99275064cc00/0xcf1365f7cb054864 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.787573:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99275064cc00/0xcf1365f7cb054864 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.787589:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99275064cc00/0xcf1365f7cb054864 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853507.787602:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853507.787621:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927436892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7076e8b-41d6-499a-b764-6185164c5ac6+8:2365:x1874700136354048:12345-192.168.206.10@tcp:103: Request processed in 175us (5100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853507.787628:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 20 00010000:00010000:3.0:1787853507.788100:0:8428:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99275064cc00/0xcf1365f7cb054864 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.788111:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99275064cc00/0xcf1365f7cb054864 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853507.788118:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99275064cc00/0xcf1365f7cb054864 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853508.486370:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787853509.126749:0:5821:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787853509.126760:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9927441ba000 from 39 10000000:01000000:0.0:1787853509.126767:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787853509.126857:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c7c00/0xcf1365f7cb05486b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853509.126872:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9927821c7c00/0xcf1365f7cb05486b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853509.126887:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927821c7c00/0xcf1365f7cb05486b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853509.126936:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992743688b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152106880:0@lo:101: 00000100:00100000:0.0:1787853509.127054:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853509.127249:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c218000 going to sleep for 11 seconds 00000100:00100000:1.0:1787853509.127346:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152106880 00000100:00100000:1.0:1787853509.127356:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152106880 00000100:00100000:1.0:1787853509.127419:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787853509.127431:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+12:5821:x1874700152106880:12345-0@lo:101: 00010000:00010000:1.0:1787853509.127447:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853509.127466:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927429f7800/0xcf1365f7cb054872 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb05486b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.127506:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927429f7800/0xcf1365f7cb054872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb05486b expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.127519:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927429f7800/0xcf1365f7cb054872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05486b expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.127530:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927429f7800, rc 0) 00000100:00100000:1.0:1787853509.127588:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:5821:x1874700152106880:12345-0@lo:101: Request processed in 158us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853509.127595:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787853509.128448:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992743688b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152106880:0@lo:101: 00010000:00010000:0.0:1787853509.128477:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927821c7c00/0xcf1365f7cb05486b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054872 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853509.128498:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927821c7c00/0xcf1365f7cb05486b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054872 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853509.128577:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992743688b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152107008:0@lo:501: 00000100:00100000:0.0:1787853509.128622:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853509.129716:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152107008 00000100:00100000:2.0:1787853509.129727:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152107008 00000100:00100000:2.0:1787853509.132353:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787853509.132369:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:5821:x1874700152107008:12345-0@lo:501: 00000100:00100000:2.0:1787853509.133709:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:5821:x1874700152107008:12345-0@lo:501: Request processed in 1301us (5044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853509.133723:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787853509.138806:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c218000 going to sleep for 11 seconds 00000100:00100000:0.0:1787853509.138872:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992743688b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152107008:0@lo:501: 00000100:00100000:0.0:1787853509.138976:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992743688b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152107136:0@lo:503: 00000100:00100000:0.0:1787853509.139086:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853509.139146:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c218000 going to sleep for 11 seconds 00000100:00100000:3.0:1787853509.139544:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152107136 00000100:00100000:3.0:1787853509.139554:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152107136 00000100:00100000:3.0:1787853509.139625:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787853509.139636:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:5821:x1874700152107136:12345-0@lo:503: 00000100:00100000:3.0:1787853509.139980:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:5821:x1874700152107136:12345-0@lo:503: Request processed in 344us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853509.139988:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787853509.142029:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992743688b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152107136:0@lo:503: 00000100:00100000:1.0:1787853509.146074:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c2030c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8447:1874700152107264:0@lo:502: 00000100:00100000:1.0:1787853509.146312:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853509.146941:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff992745a56a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787853509.147504:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152107264 00000100:00100000:2.0:1787853509.147516:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152107264 00000100:00100000:2.0:1787853509.147588:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787853509.147599:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:8447:x1874700152107264:12345-0@lo:502: 00000100:00100000:2.0:1787853509.147966:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:8447:x1874700152107264:12345-0@lo:502: Request processed in 368us (1653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853509.147981:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787853509.149473:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c2030c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8447:1874700152107264:0@lo:502: 00000100:00100000:1.0:1787853509.149588:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c2030c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8447:1874700152107392:0@lo:502: 00000100:00100000:1.0:1787853509.149704:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853509.149786:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff992745a56a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787853509.149923:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152107392 00000100:00100000:0.0:1787853509.149931:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152107392 00000100:00100000:0.0:1787853509.149991:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787853509.150001:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:8447:x1874700152107392:12345-0@lo:502: 00000100:00100000:0.0:1787853509.151086:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:8447:x1874700152107392:12345-0@lo:502: Request processed in 1081us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853509.151098:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787853509.151910:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c2030c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8447:1874700152107392:0@lo:502: 00000040:00080000:1.0:1787853509.151954:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787853509.152973:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787853509.153012:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787853509.153036:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c7c00/0xcf1365f7cb05486b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054872 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853509.153049:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9927821c7c00/0xcf1365f7cb05486b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054872 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853509.153061:0:5821:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787853509.153064:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787853509.153068:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787853509.153112:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb054879 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853509.153564:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb054879 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853509.153578:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb054879 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853509.153605:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992743688b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152107520:0@lo:101: 00000100:00100000:0.0:1787853509.153714:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853509.153942:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c218480 going to sleep for 11 seconds 00000100:00100000:3.0:1787853509.163514:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152107520 00000100:00100000:3.0:1787853509.163536:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152107520 00000100:00100000:3.0:1787853509.163640:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787853509.163655:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+13:5821:x1874700152107520:12345-0@lo:101: 00010000:00010000:3.0:1787853509.163691:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853509.163715:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99275064d600/0xcf1365f7cb054880 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb054879 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853509.163761:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99275064d600/0xcf1365f7cb054880 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb054879 expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853509.164149:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99275064d600/0xcf1365f7cb054880 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054879 expref: 14 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853509.164160:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064d600, rc 0) 00000100:00100000:3.0:1787853509.164900:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:5821:x1874700152107520:12345-0@lo:101: Request processed in 1246us (11182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853509.164911:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787853509.167006:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992743688b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152107520:0@lo:101: 00010000:00010000:0.0:1787853509.167048:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb054879 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054880 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853509.167065:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb054879 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054880 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853509.167247:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992743688b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152107648:0@lo:501: 00000100:00100000:0.0:1787853509.167613:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853509.167696:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c218480 going to sleep for 11 seconds 00000100:00100000:1.0:1787853509.169219:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152107648 00000100:00100000:1.0:1787853509.169238:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152107648 00000100:00100000:1.0:1787853509.169322:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787853509.169334:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:5821:x1874700152107648:12345-0@lo:501: 00000100:00100000:1.0:1787853509.169762:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:5821:x1874700152107648:12345-0@lo:501: Request processed in 428us (2147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853509.169771:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787853509.171281:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992743688b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152107648:0@lo:501: 00000100:00100000:0.0:1787853509.171395:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992743688b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152107776:0@lo:503: 00000100:00100000:0.0:1787853509.171521:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853509.171585:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c218480 going to sleep for 11 seconds 00000100:00100000:3.0:1787853509.172666:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152107776 00000100:00100000:3.0:1787853509.172724:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152107776 00000100:00100000:3.0:1787853509.172823:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787853509.172836:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:5821:x1874700152107776:12345-0@lo:503: 00000100:00100000:3.0:1787853509.173468:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:5821:x1874700152107776:12345-0@lo:503: Request processed in 633us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853509.173478:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787853509.174535:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992743688b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152107776:0@lo:503: 00000100:00100000:1.0:1787853509.185135:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c2030c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8448:1874700152107904:0@lo:502: 00000100:00100000:1.0:1787853509.185260:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853509.185311:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff992745a569c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853509.185427:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152107904 00000100:00100000:0.0:1787853509.185436:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152107904 00000100:00100000:0.0:1787853509.185510:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787853509.185522:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:8448:x1874700152107904:12345-0@lo:502: 00000100:00100000:0.0:1787853509.185844:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:8448:x1874700152107904:12345-0@lo:502: Request processed in 323us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853509.185853:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787853509.188962:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c2030c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8448:1874700152107904:0@lo:502: 00000020:01000000:1.0:1787853509.189031:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853509.189047:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853509.189050:0:8448:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787853509.189059:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787853509.189120:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c2030c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8448:1874700152108032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787853509.189236:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853509.189295:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff992745a569c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853509.190199:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152108032 00000100:00100000:3.0:1787853509.190211:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152108032 00000100:00100000:3.0:1787853509.190281:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787853509.190293:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:8448:x1874700152108032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853509.194032:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:8448:x1874700152108032:12345-0@lo:502:llog_process_th.0 Request processed in 3728us (4784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853509.194050:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787853509.195411:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c2030c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8448:1874700152108032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787853509.195474:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853509.195487:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853509.195637:0:8448:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787853509.195647:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1787853509.203024:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787853509.203079:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787853509.203094:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb054879 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054880 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853509.203111:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb054879 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054880 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853509.203124:0:5821:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787853509.203128:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9927660b0000 from 39 10000000:01000000:0.0:1787853509.203132:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787853509.203189:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c6200/0xcf1365f7cb054887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853509.203220:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9927821c6200/0xcf1365f7cb054887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853509.203235:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927821c6200/0xcf1365f7cb054887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853509.203270:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992743688b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152108160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787853509.203366:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853509.203428:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c218300 going to sleep for 11 seconds 00000100:00100000:3.0:1787853509.207323:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152108160 00000100:00100000:3.0:1787853509.207349:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152108160 00000100:00100000:3.0:1787853509.207445:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787853509.207458:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:5821:x1874700152108160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853509.207487:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853509.207521:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99275064c000/0xcf1365f7cb05488e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb054887 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853509.207584:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99275064c000/0xcf1365f7cb05488e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb054887 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853509.207596:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99275064c000/0xcf1365f7cb05488e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054887 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853509.207608:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064c000, rc 0) 00000100:00100000:3.0:1787853509.208042:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:5821:x1874700152108160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 583us (4673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853509.208052:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787853509.208193:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992743688b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152108160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853509.208220:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927821c6200/0xcf1365f7cb054887 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05488e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.208247:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927821c6200/0xcf1365f7cb054887 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb05488e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853509.208351:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c2030c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152108288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853509.208398:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853509.208444:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992745a569c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853509.208595:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152108288 00000100:00100000:0.0:1787853509.208601:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152108288 00000100:00100000:0.0:1787853509.208648:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787853509.208658:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:5821:x1874700152108288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853509.209033:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:5821:x1874700152108288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 376us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853509.209042:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787853509.209260:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c2030c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152108288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853509.209301:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c2030c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152108416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853509.209350:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853509.209381:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992745a569c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853509.209511:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152108416 00000100:00100000:3.0:1787853509.209517:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152108416 00000100:00100000:3.0:1787853509.209553:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787853509.209562:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:5821:x1874700152108416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853509.212014:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:5821:x1874700152108416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2440us (2651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853509.212031:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787853509.216808:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c2030c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152108416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787853509.217818:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8449:1874700152108544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853509.217923:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853509.217975:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c2186c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853509.218235:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152108544 00000100:00100000:1.0:1787853509.218244:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152108544 00000100:00100000:1.0:1787853509.218305:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787853509.218316:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:8449:x1874700152108544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787853509.219061:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:8449:x1874700152108544:12345-0@lo:502:llog_process_th.0 Request processed in 742us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853509.219071:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787853509.219641:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8449:1874700152108544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853509.220010:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8449:1874700152108672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853509.220081:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853509.220124:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c2186c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853509.220245:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152108672 00000100:00100000:1.0:1787853509.220253:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152108672 00000100:00100000:1.0:1787853509.220304:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787853509.220314:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:8449:x1874700152108672:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787853509.221010:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:8449:x1874700152108672:12345-0@lo:502:llog_process_th.0 Request processed in 693us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853509.221033:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787853509.221873:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8449:1874700152108672:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787853509.221945:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787853509.223002:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787853509.223035:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787853509.223049:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c6200/0xcf1365f7cb054887 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05488e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.223062:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9927821c6200/0xcf1365f7cb054887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05488e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853509.223074:0:5821:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787853509.223077:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1787853509.223081:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787853509.223124:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb054895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.223133:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb054895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.223144:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb054895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853509.223171:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c2030c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152108800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787853509.223243:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853509.223354:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992745a566c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853509.234718:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152108800 00000100:00100000:3.0:1787853509.234751:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152108800 00000100:00100000:3.0:1787853509.235046:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787853509.235060:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:5821:x1874700152108800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853509.235086:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853509.235114:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99275064d800/0xcf1365f7cb05489c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb054895 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853509.235154:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99275064d800/0xcf1365f7cb05489c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb054895 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853509.235190:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99275064d800/0xcf1365f7cb05489c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054895 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853509.235201:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064d800, rc 0) 00000100:00100000:3.0:1787853509.235527:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:5821:x1874700152108800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 469us (12282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853509.235535:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787853509.239824:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c2030c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152108800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853509.239867:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb054895 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05489c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.239913:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb054895 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb05489c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853509.240420:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152108928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853509.240533:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853509.240594:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c2186c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853509.243937:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152108928 00000100:00100000:1.0:1787853509.243957:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152108928 00000100:00100000:1.0:1787853509.244037:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787853509.244047:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:5821:x1874700152108928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853509.244931:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:5821:x1874700152108928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 881us (4394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853509.244943:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787853509.252051:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152108928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853509.252172:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152109056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853509.252277:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853509.252394:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276091ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787853509.252599:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152109056 00000100:00100000:3.0:1787853509.252607:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152109056 00000100:00100000:0.0:1787853509.252811:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787853509.252824:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:5821:x1874700152109056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787853509.253071:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:5821:x1874700152109056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 251us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853509.253202:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152109056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787853509.253291:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787853509.253937:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8450:1874700152109184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853509.254001:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853509.254096:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c2180c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853509.254182:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152109184 00000100:00100000:1.0:1787853509.254189:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152109184 00000100:00100000:1.0:1787853509.254233:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787853509.254242:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:8450:x1874700152109184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853509.256526:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:8450:x1874700152109184:12345-0@lo:502:llog_process_th.0 Request processed in 2272us (2512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853509.256553:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787853509.257138:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8450:1874700152109184:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787853509.257190:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787853509.257202:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853509.257206:0:8450:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787853509.257213:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787853509.257262:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8450:1874700152109312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787853509.257341:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853509.257488:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c0966c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853509.258889:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152109312 00000100:00100000:0.0:1787853509.258903:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152109312 00000100:00100000:0.0:1787853509.258983:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787853509.258995:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:8450:x1874700152109312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853509.259313:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:8450:x1874700152109312:12345-0@lo:502:llog_process_th.0 Request processed in 320us (1970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853509.259321:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787853509.259886:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8450:1874700152109312:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787853509.260032:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853509.260042:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853509.260045:0:8450:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787853509.260051:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1787853509.260271:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787853509.260295:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787853509.260308:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb054895 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05489c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853509.260336:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb054895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05489c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853509.260434:0:5821:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787853509.260438:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9927436b6000 from 39 10000000:01000000:0.0:1787853509.260442:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787853509.260489:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb0548a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853509.260497:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb0548a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853509.260506:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb0548a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853509.260604:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152109440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787853509.260892:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853509.260975:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c218900 going to sleep for 11 seconds 00000100:00100000:1.0:1787853509.261023:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152109440 00000100:00100000:1.0:1787853509.261032:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152109440 00000100:00100000:1.0:1787853509.261115:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787853509.261127:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:5821:x1874700152109440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853509.261143:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853509.261159:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927429f7400/0xcf1365f7cb0548aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0548a3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.261202:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927429f7400/0xcf1365f7cb0548aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0548a3 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.261213:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927429f7400/0xcf1365f7cb0548aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0548a3 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.261223:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927429f7400, rc 0) 00000100:00100000:1.0:1787853509.261279:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152109440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853509.261286:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787853509.261378:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152109440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853509.261395:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb0548a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0548aa expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853509.261405:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb0548a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0548aa expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853509.261468:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152109568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853509.261497:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853509.261531:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c096d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787853509.263288:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152109568 00000100:00100000:1.0:1787853509.263317:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152109568 00000100:00100000:1.0:1787853509.264180:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787853509.264193:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152109568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853509.264768:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152109568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 576us (3268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853509.265054:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787853509.265228:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152109568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853509.265294:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152109696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853509.265355:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853509.266186:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152109696 00000100:00100000:0.0:1787853509.266196:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152109696 00000100:00100000:1.0:1787853509.266282:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787853509.266289:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c096d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787853509.266297:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152109696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853509.266961:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152109696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 667us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853509.266971:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787853509.267163:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152109696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853509.268056:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8451:1874700152109824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787853509.268134:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853509.268181:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c096f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853509.268405:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152109824 00000100:00100000:2.0:1787853509.268414:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152109824 00000100:00100000:2.0:1787853509.268523:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787853509.268535:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:8451:x1874700152109824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853509.268869:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:8451:x1874700152109824:12345-0@lo:502:llog_process_th.0 Request processed in 335us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853509.268877:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787853509.268984:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8451:1874700152109824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787853509.269064:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8451:1874700152109952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787853509.269104:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853509.269348:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c096f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787853509.269516:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152109952 00000100:00100000:1.0:1787853509.269522:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152109952 00000100:00100000:1.0:1787853509.269552:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787853509.269560:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:8451:x1874700152109952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787853509.269763:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:8451:x1874700152109952:12345-0@lo:502:llog_process_th.0 Request processed in 204us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853509.269770:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787853509.269961:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8451:1874700152109952:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787853509.269987:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787853509.270329:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787853509.270351:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787853509.270362:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb0548a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0548aa expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.270375:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb0548a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0548aa expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853509.270385:0:5821:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787853509.270388:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787853509.270391:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787853509.270425:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f7a00/0xcf1365f7cb0548b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.270434:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9927429f7a00/0xcf1365f7cb0548b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.270444:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927429f7a00/0xcf1365f7cb0548b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853509.270463:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c2030c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152110080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787853509.270501:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853509.270538:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747b45e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787853509.270589:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152110080 00000100:00100000:2.0:1787853509.270595:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152110080 00000100:00100000:2.0:1787853509.270625:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787853509.270633:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152110080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853509.270645:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853509.270659:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992747f70a00/0xcf1365f7cb0548b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0548b1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853509.270816:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992747f70a00/0xcf1365f7cb0548b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0548b1 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853509.270839:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992747f70a00/0xcf1365f7cb0548b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0548b1 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853509.270849:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70a00, rc 0) 00000100:00100000:2.0:1787853509.270920:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152110080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 288us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853509.270927:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787853509.270956:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c2030c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152110080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853509.270980:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927429f7a00/0xcf1365f7cb0548b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0548b8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.271000:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927429f7a00/0xcf1365f7cb0548b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0548b8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853509.271055:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c2030c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152110208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853509.271084:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853509.271111:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747b45e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787853509.271148:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152110208 00000100:00100000:0.0:1787853509.271153:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152110208 00000100:00100000:0.0:1787853509.271186:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787853509.271194:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152110208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853509.271503:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152110208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853509.271510:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787853509.271812:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c2030c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152110208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853509.271847:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c2030c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152110336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853509.271918:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853509.271950:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747b45e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787853509.271954:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152110336 00000100:00100000:1.0:1787853509.271958:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152110336 00000100:00100000:1.0:1787853509.272030:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787853509.272041:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152110336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853509.272236:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152110336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853509.272243:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787853509.272312:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c2030c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152110336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853509.273096:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8452:1874700152110464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853509.273165:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853509.273347:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152110464 00000100:00100000:0.0:1787853509.273361:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152110464 00000100:00100000:0.0:1787853509.273442:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787853509.273451:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:8452:x1874700152110464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853509.273728:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:8452:x1874700152110464:12345-0@lo:502:llog_process_th.0 Request processed in 277us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853509.273732:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff992742d6df00 going to sleep for 11 seconds 00000100:00100000:0.0:1787853509.273736:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787853509.273753:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8452:1874700152110464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787853509.273794:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787853509.273805:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853509.273808:0:8452:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787853509.273815:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787853509.273839:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8452:1874700152110592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853509.273887:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853509.273912:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff992758543d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787853509.273928:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152110592 00000100:00100000:1.0:1787853509.273934:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152110592 00000100:00100000:1.0:1787853509.273964:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787853509.273972:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:8452:x1874700152110592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787853509.274150:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:8452:x1874700152110592:12345-0@lo:502:llog_process_th.0 Request processed in 178us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853509.274157:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787853509.274210:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8452:1874700152110592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787853509.274358:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853509.274364:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853509.274366:0:8452:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787853509.274371:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787853509.274547:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1787853509.274566:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787853509.274575:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f7a00/0xcf1365f7cb0548b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0548b8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853509.274584:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9927429f7a00/0xcf1365f7cb0548b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0548b8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853509.274593:0:5821:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787853509.274595:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99274364b3a0 from 1 10000000:01000000:0.0:1787853509.274597:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787853509.274622:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c6400/0xcf1365f7cb0548bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853509.274630:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9927821c6400/0xcf1365f7cb0548bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853509.274641:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927821c6400/0xcf1365f7cb0548bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853509.274657:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152110720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787853509.274852:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853509.274897:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c218900 going to sleep for 11 seconds 00000100:00100000:1.0:1787853509.274908:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152110720 00000100:00100000:1.0:1787853509.274914:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152110720 00000100:00100000:1.0:1787853509.274953:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787853509.274961:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152110720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853509.274973:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853509.274989:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb0548c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0548bf expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.275016:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb0548c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0548bf expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.275028:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb0548c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0548bf expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.275039:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927429f7c00, rc 0) 00000100:00100000:1.0:1787853509.275071:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152110720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853509.275078:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787853509.275105:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152110720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853509.275120:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927821c6400/0xcf1365f7cb0548bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0548c6 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853509.275129:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927821c6400/0xcf1365f7cb0548bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0548c6 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853509.275176:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152110848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853509.275202:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853509.275222:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c218900 going to sleep for 11 seconds 00000100:00100000:1.0:1787853509.275289:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152110848 00000100:00100000:1.0:1787853509.275293:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152110848 00000100:00100000:1.0:1787853509.275324:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787853509.275330:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152110848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853509.275763:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152110848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 433us (559us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787853509.275784:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787853509.275852:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152110848:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787853509.275874:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787853509.275880:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c6400/0xcf1365f7cb0548bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0548c6 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853509.275889:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9927821c6400/0xcf1365f7cb0548bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0548c6 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853509.449066:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787853509.449115:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c203480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152110976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853509.449202:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853509.449377:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152110976 00000100:00100000:0.0:1787853509.449388:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152110976 00000100:00100000:0.0:1787853509.449473:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787853509.449484:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152110976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787853509.449533:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853509.449594:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152110976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853509.449603:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787853509.449650:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277c203480 x1874700152110976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853509.449806:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c203480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152110976:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787853509.450038:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787853509.510225:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853509.563834:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853509.563993:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853509.564032:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853509.564071:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853509.564170:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136354432 00000100:00100000:1.0:1787853509.564182:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136354432 00000100:00100000:1.0:1787853509.564248:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136354560 00000100:00100000:1.0:1787853509.564252:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136354560 00000100:00100000:1.0:1787853509.564273:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:1.0:1787853509.564283:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c203c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136354432:12345-192.168.206.10@tcp:400: 00000100:00100000:1.0:1787853509.564371:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c203c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136354432:12345-192.168.206.10@tcp:400: Request processed in 88us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853509.564379:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:1.0:1787853509.564398:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:1.0:1787853509.564405:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c203480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2364:x1874700136354560:12345-192.168.206.10@tcp:400: 00000100:00100000:1.0:1787853509.564430:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c203480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2364:x1874700136354560:12345-192.168.206.10@tcp:400: Request processed in 26us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853509.564437:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00080000:1.0:1787853509.564460:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787853509.564464:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853509.565558:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136354176 00000100:00100000:3.0:1787853509.565569:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136354176 00000100:00100000:3.0:1787853509.565632:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 164 00000100:00100000:3.0:1787853509.565643:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+8:2365:x1874700136354176:12345-192.168.206.10@tcp:400: 00000100:00100000:3.0:1787853509.565760:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+8:2365:x1874700136354176:12345-192.168.206.10@tcp:400: Request processed in 118us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853509.565785:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 164 00000100:00100000:2.0:1787853509.569050:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136354304 00000100:00100000:2.0:1787853509.569073:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136354304 00000100:00100000:2.0:1787853509.569445:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:2.0:1787853509.569459:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c200f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2364:x1874700136354304:12345-192.168.206.10@tcp:400: 00000100:00100000:2.0:1787853509.569575:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c200f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2364:x1874700136354304:12345-192.168.206.10@tcp:400: Request processed in 120us (5755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853509.569584:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00080000:1.0:1787853509.574289:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853509.755544:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853509.760499:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136354688 00000100:00100000:1.0:1787853509.760522:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136354688 00000100:00100000:1.0:1787853509.761000:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 165 00000100:00100000:1.0:1787853509.761015:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+8:5602:x1874700136354688:12345-192.168.206.10@tcp:101: 00010000:00010000:1.0:1787853509.761039:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853509.761062:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927429f7e00/0xcf1365f7cb0548cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1eaa expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.761101:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927429f7e00/0xcf1365f7cb0548cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1eaa expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.761165:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927429f7e00/0xcf1365f7cb0548cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1eaa expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.761177:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927429f7e00, rc 0) 00000100:00100000:1.0:1787853509.761281:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+9:5602:x1874700136354688:12345-192.168.206.10@tcp:101: Request processed in 269us (5751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853509.761288:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 165 00000100:00100000:0.0:1787853509.767976:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853509.768607:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136354816 00000100:00100000:1.0:1787853509.768622:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136354816 00000100:00100000:1.0:1787853509.768759:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 166 00000100:00100000:1.0:1787853509.768788:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+9:5602:x1874700136354816:12345-192.168.206.10@tcp:501: 00000100:00100000:1.0:1787853509.769102:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+9:5602:x1874700136354816:12345-192.168.206.10@tcp:501: Request processed in 332us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853509.769111:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 166 00000100:00100000:2.0:1787853509.781106:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853509.784233:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136354944 00000100:00100000:1.0:1787853509.784256:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136354944 00000100:00100000:1.0:1787853509.784466:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 167 00000100:00100000:1.0:1787853509.784479:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+9:5602:x1874700136354944:12345-192.168.206.10@tcp:503: 00000100:00100000:1.0:1787853509.784831:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+9:5602:x1874700136354944:12345-192.168.206.10@tcp:503: Request processed in 353us (3734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853509.784840:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 167 00000100:00100000:0.0:1787853509.798944:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853509.799077:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136355072 00000100:00100000:1.0:1787853509.799089:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136355072 00000100:00100000:1.0:1787853509.799347:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 168 00000100:00100000:1.0:1787853509.799360:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+9:6074:x1874700136355072:12345-192.168.206.10@tcp:502: 00000100:00100000:1.0:1787853509.799783:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+9:6074:x1874700136355072:12345-192.168.206.10@tcp:502: Request processed in 415us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853509.799792:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 168 00000100:00100000:0.0:1787853509.808371:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853509.809278:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136355200 00000100:00100000:1.0:1787853509.809527:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136355200 00000100:00100000:1.0:1787853509.809881:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 169 00000100:00100000:1.0:1787853509.809894:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+9:6074:x1874700136355200:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787853509.810266:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+9:6074:x1874700136355200:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 375us (2199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853509.810276:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 169 00000100:00100000:2.0:1787853509.818123:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853509.819629:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136355328 00000100:00100000:1.0:1787853509.819648:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136355328 00000100:00100000:1.0:1787853509.819794:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 170 00000100:00100000:1.0:1787853509.819806:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+9:5602:x1874700136355328:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853509.819826:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853509.819848:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927429f6400/0xcf1365f7cb0548d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1eb1 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.820033:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927429f6400/0xcf1365f7cb0548d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1eb1 expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.820048:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927429f6400/0xcf1365f7cb0548d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1eb1 expref: 10 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853509.820060:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927429f6400, rc 0) 00000100:00100000:1.0:1787853509.823857:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+10:5602:x1874700136355328:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 4034us (5737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853509.823902:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 170 00000100:00100000:0.0:1787853509.844563:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853509.845141:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136355456 00000100:00100000:1.0:1787853509.845155:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136355456 00000100:00100000:1.0:1787853509.845250:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 171 00000100:00100000:1.0:1787853509.845263:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+10:5602:x1874700136355456:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853509.845639:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+10:5602:x1874700136355456:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 378us (1089us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787853509.845649:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 171 00010000:00010000:0.0:1787853510.533875:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787853510.952493:0:8489:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3243f9c0 20000000:00000080:2.0:1787853510.952518:0:8489:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99277c582800 uarg=0000000000000000 20000000:01000000:2.0:1787853510.952626:0:8489:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787853510.952635:0:8489:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787853510.952641:0:8489:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787853510.953979:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787853510.954304:0:8489:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787853510.964737:0:8489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787853510.966016:0:8489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787853510.966306:0:8489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787853510.966334:0:8489:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787853510.966432:0:8489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548db lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853510.966455:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054650 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054649 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853510.966465:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9927429f7600/0xcf1365f7cb0546b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0546ab expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853510.966472:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99275064ca00/0xcf1365f7cb05477d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054776 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853510.966483:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9927429f6200/0xcf1365f7cb05483a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e79 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853510.966512:0:8489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548db lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853510.966562:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9927429f6200/0xcf1365f7cb05483a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e79 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853510.966584:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9927429f6200/0xcf1365f7cb05483a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e79 expref: 9 pid: 5818 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853510.966602:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c2003c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874700152111104:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787853510.966784:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99275064ca00/0xcf1365f7cb05477d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb054776 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853510.966793:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99275064ca00/0xcf1365f7cb05477d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb054776 expref: 18 pid: 5819 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853510.966803:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c203840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874700152111232:0@lo:104: 00000100:00100000:1.0:1787853510.966866:0:8489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853510.970868:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853510.970984:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136355584 00000100:00100000:3.0:1787853510.970998:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136355584 00010000:00010000:3.0:1787853510.971055:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9927429f6200/0xcf1365f7cb05483a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e79 expref: 10 pid: 5818 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853510.971102:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:3.0:1787853510.971116:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274368b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2365:x1874700136355584:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853510.971136:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853510.971143:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9927429f6200/0xcf1365f7cb05483a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e79 expref: 10 pid: 5818 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853510.971160:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9927429f6200/0xcf1365f7cb05483a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e79 expref: 10 pid: 5818 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853510.971179:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9927429f7600/0xcf1365f7cb0546b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb0546ab expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853510.971265:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9927429f7600/0xcf1365f7cb0546b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb0546ab expref: 18 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853510.971286:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874700152111360:0@lo:104: 00000100:00100000:1.0:1787853510.971374:0:8489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787853510.974335:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853510.975755:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274368b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2365:x1874700136355584:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 4627us (4887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853510.975811:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 21 00010000:00010000:1.0:1787853510.976157:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb054649 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853510.976181:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054650 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb054649 expref: 18 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853510.976194:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874700152111488:0@lo:104: 00000100:00100000:1.0:1787853510.976263:0:8489:0:(client.c:2715:ptlrpc_set_wait()) set ffff992748eb8180 going to sleep for 11 seconds 00010000:00010000:1.0:1787853510.976298:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927429f6200/0xcf1365f7cb05483a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e79 expref: 9 pid: 5818 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853510.976313:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c2003c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874700152111104:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787853510.976787:0:5807:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787853510.977904:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853510.977933:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152111232 00000100:00100000:1.0:1787853510.977943:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152111232 00000100:00100000:1.0:1787853510.978001:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152111360 00000100:00100000:1.0:1787853510.978005:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152111360 00000100:00100000:1.0:1787853510.978017:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152111488 00000100:00100000:1.0:1787853510.978020:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152111488 00000100:00100000:1.0:1787853510.978035:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787853510.978045:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+5:8489:x1874700152111232:12345-0@lo:104: 00010000:00010000:1.0:1787853510.978065:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff992747f71600/0xcf1365f7cb054776 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb05477d expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853510.979309:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787853510.979326:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+5:8489:x1874700152111232:12345-0@lo:104: Request processed in 1279us (12456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853510.979340:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1787853510.979341:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853510.979354:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff992747f71600/0xcf1365f7cb054776 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb05477d expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853510.979483:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c203840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874700152111232:0@lo:104: 00010000:00010000:0.0:1787853510.979577:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71600 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:0.0:1787853510.979582:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff992747f71600/0xcf1365f7cb054776 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb05477d expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853510.979592:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff992747f71600/0xcf1365f7cb054776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb05477d expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853510.979600:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff992747f71600/0xcf1365f7cb054776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb05477d expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853510.979607:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787853510.979665:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff992747f71600/0xcf1365f7cb054776 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb05477d expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853510.979701:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853510.979727:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff992747f71600/0xcf1365f7cb054776 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb05477d expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853510.979750:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff992747f71600/0xcf1365f7cb054776 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb05477d expref: -99 pid: 7602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853510.979772:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853510.979774:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853510.979884:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853510.979903:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992743689680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152111616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853510.979967:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853510.980038:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152111616 00000100:00100000:2.0:1787853510.980047:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152111616 00010000:00010000:2.0:1787853510.980080:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99275064ca00/0xcf1365f7cb05477d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb054776 expref: 19 pid: 5819 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853510.980123:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787853510.980143:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99275aa28b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152111616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787853510.980160:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853510.980166:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99275064ca00/0xcf1365f7cb05477d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb054776 expref: 19 pid: 5819 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853510.980179:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99275064ca00/0xcf1365f7cb05477d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb054776 expref: 19 pid: 5819 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853510.980428:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99275064ca00/0xcf1365f7cb05477d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb054776 expref: 19 pid: 5819 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853510.980447:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853510.980498:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99275aa28b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:3297:x1874700152111616:12345-0@lo:103:ldlm_bl.0 Request processed in 366us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853510.980505:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787853510.980541:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992743689680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152111616:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853510.981282:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853510.981312:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787853510.981328:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c582050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+4:8489:x1874700152111360:12345-0@lo:104: 00010000:00010000:0.0:1787853510.981343:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff992740031600/0xcf1365f7cb0546ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0546b2 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853510.981698:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787853510.981705:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c582050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+4:8489:x1874700152111360:12345-0@lo:104: Request processed in 385us (10332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853510.981713:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787853510.982043:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874700152111360:0@lo:104: 00010000:00010000:3.0:1787853510.982114:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853510.982122:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff992740031600/0xcf1365f7cb0546ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0546b2 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853510.982194:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787853510.982266:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:8489:x1874700152111488:12345-0@lo:104: 00010000:00010000:0.0:1787853510.982276:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb054649 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054650 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853510.982338:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787853510.982344:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:8489:x1874700152111488:12345-0@lo:104: Request processed in 84us (4446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853510.982350:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787853510.982428:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031600 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1787853510.982436:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff992740031600/0xcf1365f7cb0546ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb0546b2 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853510.982446:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff992740031600/0xcf1365f7cb0546ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb0546b2 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853510.982454:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff992740031600/0xcf1365f7cb0546ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb0546b2 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853510.982460:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787853510.982505:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff992740031600/0xcf1365f7cb0546ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0546b2 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853510.982512:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787853510.982532:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff992740031600/0xcf1365f7cb0546ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0546b2 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853510.982539:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff992740031600/0xcf1365f7cb0546ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0546b2 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853510.982553:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853510.982556:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb054649 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054650 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853510.982580:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031000 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1787853510.982583:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb054649 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb054650 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853510.982589:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb054649 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb054650 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853510.982595:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb054649 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb054650 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853510.982599:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787853510.982614:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb054649 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054650 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853510.982620:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787853510.982625:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb054649 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054650 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853510.982632:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb054649 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054650 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853510.982646:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853510.982648:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853510.982650:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853510.982936:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152111744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853510.982992:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853510.983044:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787853510.983051:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152111872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853510.983072:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787853510.983107:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853510.983188:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874700152111488:0@lo:104: 00010000:00010000:1.0:1787853510.983350:0:8489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548db lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853510.983483:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152111744 00000100:00100000:0.0:1787853510.983490:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152111744 00010000:00010000:0.0:1787853510.983520:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9927429f7600/0xcf1365f7cb0546b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0546ab expref: 18 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853510.983557:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152111872 00000100:00100000:0.0:1787853510.983561:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152111872 00010000:00010000:0.0:1787853510.983574:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054650 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb054649 expref: 19 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853510.983708:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787853510.983717:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99275aa283c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152111744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853510.983731:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853510.983737:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9927429f7600/0xcf1365f7cb0546b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0546ab expref: 19 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853510.983749:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9927429f7600/0xcf1365f7cb0546b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb0546ab expref: 19 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853510.983780:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927429f7600/0xcf1365f7cb0546b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb0546ab expref: 19 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853510.983796:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853510.983838:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99275aa283c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:3299:x1874700152111744:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853510.983846:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787853510.983862:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787853510.983868:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99275aa2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:3299:x1874700152111872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853510.983887:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853510.983892:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054650 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb054649 expref: 17 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853510.983901:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb054649 expref: 17 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853510.983920:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054650 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb054649 expref: 17 pid: 5818 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853510.983934:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548db lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853510.983944:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548db lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853510.983961:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548db lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853510.983969:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548db lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853510.983976:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548db lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853510.983983:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853510.983989:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927429f6600 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853510.983993:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853510.984001:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548db lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853510.984015:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548db lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853510.984036:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853510.984064:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99275aa2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:3299:x1874700152111872:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853510.984070:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787853510.984483:0:8489:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548db lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853510.984494:0:8489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548db lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853510.984499:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548db lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853510.992898:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152111872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853510.992920:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152111744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853511.495224:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992743689e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152112000:0@lo:400:kworker.0 00000100:00100000:0.0:1787853511.495312:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853511.495386:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152112512:0@lo:400:kworker.0 00000100:00100000:0.0:1787853511.495414:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853511.495451:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853511.495457:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992743689680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152112128:0@lo:400:kworker.0 00000100:00100000:0.0:1787853511.495482:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853511.495512:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152112256:0@lo:400:kworker.0 00000100:00100000:0.0:1787853511.495536:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853511.495556:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787853511.495561:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152112384:0@lo:400:kworker.0 00000100:00100000:0.0:1787853511.495583:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853511.495618:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152112000 00000100:00100000:0.0:1787853511.495626:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152112000 00000100:00100000:0.0:1787853511.495701:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152112128 00000100:00100000:0.0:1787853511.495705:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152112128 00000100:00100000:0.0:1787853511.495742:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152112384 00000100:00100000:0.0:1787853511.495746:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152112384 00000100:00100000:0.0:1787853511.495778:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787853511.495787:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743688b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152112000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853511.495847:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743688b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152112000:12345-0@lo:400:kworker.0 Request processed in 61us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853511.495864:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787853511.495886:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787853511.495892:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274368bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152112128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853511.495923:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274368bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152112128:12345-0@lo:400:kworker.0 Request processed in 32us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853511.495930:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787853511.495941:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787853511.495948:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152112384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853511.495981:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152112384:12345-0@lo:400:kworker.0 Request processed in 34us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853511.495987:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787853511.496006:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152112512 00000100:00100000:0.0:1787853511.496009:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152112512 00000100:00100000:0.0:1787853511.496038:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152112256 00000100:00100000:0.0:1787853511.496041:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152112256 00000100:00100000:0.0:1787853511.496056:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787853511.496062:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274368b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152112512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853511.496093:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274368b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152112512:12345-0@lo:400:kworker.0 Request processed in 32us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853511.496100:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787853511.496110:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787853511.496117:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743688f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152112256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853511.496145:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743688f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152112256:12345-0@lo:400:kworker.0 Request processed in 30us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853511.496152:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787853511.496209:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152112384:0@lo:400:kworker.0 00010000:00080000:0.0:1787853511.496225:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99274368b0c0 x1874700152112256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853511.496235:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152112256:0@lo:400:kworker.0 00000100:00100000:0.0:1787853511.496268:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992743689680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152112128:0@lo:400:kworker.0 00000100:00100000:0.0:1787853511.496279:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992743689e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152112000:0@lo:400:kworker.0 00010000:00080000:0.0:1787853511.496288:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99274368a580 x1874700152112512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853511.496297:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152112512:0@lo:400:kworker.0 00000100:00080000:2.0:1787853511.496359:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787853511.496364:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787853511.496367:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853511.496479:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152112640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853511.496514:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853511.496965:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152112640 00000100:00100000:2.0:1787853511.496972:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152112640 00000100:00100000:2.0:1787853511.497061:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787853511.497072:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152112640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853511.497110:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853511.497212:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152112640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853511.497220:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787853511.497422:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99276dac12c0 x1874700152112640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853511.497441:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152112640:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787853511.557927:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787853512.075020:0:5821:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787853512.075030:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9927441ba000 from 4 10000000:01000000:0.0:1787853512.075037:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787853512.075114:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb0548e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853512.075128:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb0548e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853512.075141:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb0548e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853512.075194:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152112768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787853512.075286:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853512.075467:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152112768 00000100:00100000:1.0:1787853512.075477:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152112768 00000100:00100000:1.0:1787853512.075557:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787853512.075569:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:5821:x1874700152112768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853512.075585:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853512.075603:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0548e2 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853512.075633:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0548e2 expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853512.075646:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0548e2 expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853512.075655:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927429f6600, rc 0) 00000100:00100000:1.0:1787853512.077949:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152112768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2371us (2651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853512.077976:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787853512.078447:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992748cc3180 going to sleep for 11 seconds 00000100:00100000:0.0:1787853512.078483:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152112768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853512.079155:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb0548e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0548e9 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853512.079174:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb0548e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0548e9 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853512.079272:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152112896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853512.079501:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853512.079592:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992748cc3180 going to sleep for 11 seconds 00000100:00100000:2.0:1787853512.079710:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152112896 00000100:00100000:2.0:1787853512.079718:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152112896 00000100:00100000:2.0:1787853512.079784:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787853512.079804:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152112896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853512.082258:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152112896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2447us (2748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853512.082273:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787853512.082793:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152112896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853512.082871:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152113024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853512.082951:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853512.083013:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d12c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787853512.083335:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152113024 00000100:00100000:0.0:1787853512.083343:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152113024 00000100:00100000:0.0:1787853512.083405:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787853512.083416:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152113024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787853512.084115:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152113024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 697us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853512.084126:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787853512.096976:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152113024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853512.098457:0:8530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8530:1874700152113152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853512.098700:0:8530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853512.098768:0:8530:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d55480 going to sleep for 11 seconds 00000100:00100000:0.0:1787853512.100746:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152113152 00000100:00100000:0.0:1787853512.100772:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152113152 00000100:00100000:0.0:1787853512.100874:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787853512.100885:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:8530:x1874700152113152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853512.101427:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:8530:x1874700152113152:12345-0@lo:502:llog_process_th.0 Request processed in 542us (2866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853512.101436:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787853512.101770:0:8530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8530:1874700152113152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787853512.101815:0:8530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787853512.101829:0:8530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853512.101832:0:8530:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787853512.101843:0:8530:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9927441ba000 00000020:00000080:2.0:1787853512.101846:0:8530:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787853512.102001:0:8530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8530:1874700152113280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853512.102060:0:8530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853512.102119:0:8530:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d55480 going to sleep for 11 seconds 00000100:00100000:0.0:1787853512.102238:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152113280 00000100:00100000:0.0:1787853512.102244:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152113280 00000100:00100000:0.0:1787853512.102288:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787853512.102297:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:8530:x1874700152113280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853512.102484:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:8530:x1874700152113280:12345-0@lo:502:llog_process_th.0 Request processed in 187us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853512.102491:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787853512.108030:0:8530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8530:1874700152113280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787853512.108203:0:8530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853512.108219:0:8530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853512.108221:0:8530:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787853512.108229:0:8530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787853512.108320:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787853512.108350:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787853512.108376:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb0548e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0548e9 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853512.108391:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb0548e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0548e9 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853512.108404:0:5821:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787853512.108407:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9927660b0000 from 4 10000000:01000000:2.0:1787853512.108410:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787853512.108452:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb0548f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853512.108461:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb0548f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853512.108471:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb0548f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853512.108497:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152113408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787853512.108579:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853512.108634:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d55480 going to sleep for 11 seconds 00000100:00100000:1.0:1787853512.108976:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152113408 00000100:00100000:1.0:1787853512.108985:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152113408 00000100:00100000:1.0:1787853512.109038:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787853512.109049:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152113408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853512.109065:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853512.110530:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927429f6200/0xcf1365f7cb0548f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0548f0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853512.110574:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927429f6200/0xcf1365f7cb0548f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0548f0 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853512.110588:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927429f6200/0xcf1365f7cb0548f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0548f0 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853512.110599:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927429f6200, rc 0) 00000100:00100000:1.0:1787853512.110704:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152113408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1655us (2124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853512.110714:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787853512.111153:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152113408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853512.111175:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb0548f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0548f7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853512.111187:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb0548f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0548f7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853512.111280:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152113536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853512.111452:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853512.111504:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d55480 going to sleep for 11 seconds 00000100:00100000:3.0:1787853512.112488:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152113536 00000100:00100000:3.0:1787853512.112501:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152113536 00000100:00100000:3.0:1787853512.112589:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787853512.112601:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152113536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853512.112982:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152113536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 383us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853512.112999:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787853512.113061:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152113536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853512.113134:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152113664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853512.113188:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853512.113223:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277d314540 going to sleep for 11 seconds 00000100:00100000:3.0:1787853512.113238:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152113664 00000100:00100000:3.0:1787853512.113243:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152113664 00000100:00100000:3.0:1787853512.113267:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787853512.113275:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152113664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853512.114604:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152113664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1324us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853512.114616:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787853512.117181:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152113664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853512.118569:0:8535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8535:1874700152113792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787853512.119166:0:8535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853512.119233:0:8535:0:(client.c:2715:ptlrpc_set_wait()) set ffff992748eb8480 going to sleep for 11 seconds 00000100:00100000:3.0:1787853512.119305:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152113792 00000100:00100000:3.0:1787853512.119380:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152113792 00000100:00100000:3.0:1787853512.119484:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787853512.119496:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:8535:x1874700152113792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787853512.119839:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:8535:x1874700152113792:12345-0@lo:502:llog_process_th.0 Request processed in 345us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853512.119849:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787853512.120144:0:8535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8535:1874700152113792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787853512.120181:0:8535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853512.120193:0:8535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853512.120196:0:8535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787853512.120206:0:8535:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9927660b0000 00000020:00000080:1.0:1787853512.120215:0:8535:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787853512.120943:0:8535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748f5f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8535:1874700152113920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853512.121021:0:8535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853512.121058:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152113920 00000100:00100000:2.0:1787853512.121066:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152113920 00000100:00100000:0.0:1787853512.121068:0:8535:0:(client.c:2715:ptlrpc_set_wait()) set ffff992758973300 going to sleep for 11 seconds 00000100:00100000:2.0:1787853512.121120:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787853512.121130:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:8535:x1874700152113920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853512.121351:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:8535:x1874700152113920:12345-0@lo:502:llog_process_th.0 Request processed in 222us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853512.121360:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787853512.121485:0:8535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748f5f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8535:1874700152113920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787853512.121515:0:8535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853512.121523:0:8535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853512.121525:0:8535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787853512.121531:0:8535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787853512.121723:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787853512.121747:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787853512.121770:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb0548f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0548f7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853512.121784:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb0548f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0548f7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853512.121796:0:5821:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787853512.121799:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9927436b6000 from 4 10000000:01000000:1.0:1787853512.121802:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787853512.121834:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f6800/0xcf1365f7cb0548fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853512.121843:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9927429f6800/0xcf1365f7cb0548fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853512.121853:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927429f6800/0xcf1365f7cb0548fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853512.121869:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152114048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787853512.121908:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853512.121938:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992748eb8480 going to sleep for 11 seconds 00000100:00100000:1.0:1787853512.121954:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152114048 00000100:00100000:1.0:1787853512.121959:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152114048 00000100:00100000:1.0:1787853512.121990:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787853512.121999:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152114048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853512.122012:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853512.122029:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927429f7600/0xcf1365f7cb054905 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0548fe expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853512.122065:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927429f7600/0xcf1365f7cb054905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0548fe expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853512.122151:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927429f7600/0xcf1365f7cb054905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0548fe expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853512.122162:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927429f7600, rc 0) 00000100:00100000:1.0:1787853512.122199:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152114048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853512.122207:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787853512.122245:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152114048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853512.122259:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927429f6800/0xcf1365f7cb0548fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054905 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853512.122268:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927429f6800/0xcf1365f7cb0548fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054905 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853512.123444:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152114176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853512.123498:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853512.123530:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992748eb8480 going to sleep for 11 seconds 00000100:00100000:1.0:1787853512.123561:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152114176 00000100:00100000:1.0:1787853512.123567:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152114176 00000100:00100000:1.0:1787853512.123606:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787853512.123616:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152114176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853512.124765:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152114176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1135us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853512.124789:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787853512.124931:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152114176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853512.124987:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152114304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853512.125039:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853512.125555:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d55b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787853512.126453:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152114304 00000100:00100000:1.0:1787853512.126466:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152114304 00000100:00100000:1.0:1787853512.126537:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787853512.126548:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152114304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853512.126855:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152114304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 308us (1814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853512.126864:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787853512.126935:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152114304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853512.136864:0:8536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8536:1874700152114432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853512.136979:0:8536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853512.137034:0:8536:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d55f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787853512.138452:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152114432 00000100:00100000:1.0:1787853512.138467:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152114432 00000100:00100000:1.0:1787853512.138531:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787853512.138543:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:8536:x1874700152114432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787853512.138873:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:8536:x1874700152114432:12345-0@lo:502:llog_process_th.0 Request processed in 332us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853512.138882:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787853512.139604:0:8536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8536:1874700152114432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787853512.139651:0:8536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787853512.139662:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853512.139665:0:8536:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787853512.139693:0:8536:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9927436b6000 00000020:00000080:2.0:1787853512.139696:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787853512.139811:0:8536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8536:1874700152114560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853512.139868:0:8536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853512.139904:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152114560 00000100:00100000:2.0:1787853512.139916:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152114560 00000100:00100000:2.0:1787853512.139952:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787853512.139960:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:8536:x1874700152114560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853512.141844:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:8536:x1874700152114560:12345-0@lo:502:llog_process_th.0 Request processed in 1873us (1963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853512.141859:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787853512.141931:0:8536:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d55f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853512.141956:0:8536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:8536:1874700152114560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787853512.141994:0:8536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853512.142002:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853512.142005:0:8536:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787853512.142012:0:8536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787853512.153437:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787853512.153478:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787853512.153493:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f6800/0xcf1365f7cb0548fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054905 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853512.153508:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9927429f6800/0xcf1365f7cb0548fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054905 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853512.443038:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853512.443110:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136355712 00000100:00100000:1.0:1787853512.443119:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136355712 00000100:00100000:1.0:1787853512.443190:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 187 00000100:00100000:1.0:1787853512.443199:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+9:5602:x1874700136355712:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853512.443215:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853512.443241:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927429f7000/0xcf1365f7cb05490c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1eb8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853512.443268:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927429f7000/0xcf1365f7cb05490c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1eb8 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853512.443292:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927429f7000/0xcf1365f7cb05490c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1eb8 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853512.443302:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927429f7000, rc 0) 00000100:00100000:1.0:1787853512.443364:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+10:5602:x1874700136355712:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 165us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853512.443373:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 187 00000100:00100000:0.0:1787853512.447306:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853512.447418:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136355840 00000100:00100000:3.0:1787853512.447427:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136355840 00000100:00100000:3.0:1787853512.447493:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 188 00000100:00100000:3.0:1787853512.447505:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992758772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+10:5602:x1874700136355840:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853512.447875:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992758772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+10:5602:x1874700136355840:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 372us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853512.447883:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 188 00000100:00100000:3.0:1787853512.454859:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853512.454931:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136355968 00000100:00100000:1.0:1787853512.454940:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136355968 00000100:00100000:1.0:1787853512.454989:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 189 00000100:00100000:1.0:1787853512.454999:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992758771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+10:5602:x1874700136355968:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853512.455211:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992758771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+10:5602:x1874700136355968:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 Request processed in 212us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853512.455218:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 189 00000100:00100000:1.0:1787853512.463534:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853512.463770:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136356096 00000100:00100000:0.0:1787853512.463781:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136356096 00000100:00100000:0.0:1787853512.463859:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 190 00000100:00100000:0.0:1787853512.463875:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+10:6138:x1874700136356096:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787853512.464105:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+10:6138:x1874700136356096:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 232us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853512.464114:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 190 00000100:00100000:0.0:1787853512.473404:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853512.473541:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136356224 00000100:00100000:3.0:1787853512.473549:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136356224 00000100:00100000:3.0:1787853512.473605:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 191 00000100:00100000:3.0:1787853512.473615:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+10:6138:x1874700136356224:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787853512.473901:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+10:6138:x1874700136356224:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 285us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853512.473910:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 191 00010000:00010000:0.0:1787853512.582874:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853513.611990:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853514.566910:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152114688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853514.566983:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853514.567065:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152114688 00000100:00100000:1.0:1787853514.567073:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152114688 00000100:00100000:1.0:1787853514.567127:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787853514.567135:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152114688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787853514.567176:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853514.567224:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152114688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853514.567241:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787853514.567263:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787853514.567293:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277bc3f480 x1874700152114688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853514.567310:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152114688:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787853514.630118:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853514.683464:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853514.683511:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853514.683552:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853514.683583:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853514.683615:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136356480 00000100:00100000:0.0:1787853514.683624:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136356480 00000100:00100000:0.0:1787853514.683715:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:0.0:1787853514.683725:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2363:x1874700136356480:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853514.683802:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2363:x1874700136356480:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 78us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853514.683809:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:0.0:1787853514.683830:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136356608 00000100:00100000:0.0:1787853514.683834:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136356608 00000100:00100000:0.0:1787853514.683859:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136356736 00000100:00100000:0.0:1787853514.683873:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136356736 00000100:00100000:0.0:1787853514.683893:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:0.0:1787853514.683899:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2363:x1874700136356608:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853514.683927:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2363:x1874700136356608:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 28us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853514.683933:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:0.0:1787853514.683945:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:0.0:1787853514.683951:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274368ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2363:x1874700136356736:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853514.683972:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274368ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2363:x1874700136356736:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 22us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853514.683978:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00080000:0.0:1787853514.683993:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787853514.683997:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787853514.683999:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853514.684213:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136356352 00000100:00100000:3.0:1787853514.684217:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136356352 00000100:00100000:3.0:1787853514.684250:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 192 00000100:00100000:3.0:1787853514.684258:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2363:x1874700136356352:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787853514.684290:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2363:x1874700136356352:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 32us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853514.684297:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 192 00010000:00010000:1.0:1787853515.654852:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853516.617650:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152114816:0@lo:400:kworker.0 00000100:00100000:0.0:1787853516.617749:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853516.617805:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152115328:0@lo:400:kworker.0 00000100:00100000:2.0:1787853516.617828:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152114816 00000100:00100000:0.0:1787853516.617833:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853516.617835:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152114816 00000100:00100000:0.0:1787853516.617861:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853516.617867:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152115200:0@lo:400:kworker.0 00000100:00100000:0.0:1787853516.617890:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853516.617891:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787853516.617901:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3300:x1874700152114816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853516.617919:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992743689e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152114944:0@lo:400:kworker.0 00000100:00100000:0.0:1787853516.617941:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853516.617951:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3300:x1874700152114816:12345-0@lo:400:kworker.0 Request processed in 52us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853516.617955:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992775481e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152115456:0@lo:400:kworker.0 00000100:00100000:2.0:1787853516.617958:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787853516.618010:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152115200 00000100:00100000:2.0:1787853516.618014:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152115200 00000100:00100000:2.0:1787853516.618047:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787853516.618054:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152115200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853516.618086:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152115200:12345-0@lo:400:kworker.0 Request processed in 33us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853516.618092:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787853516.618119:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152115328 00000100:00100000:2.0:1787853516.618123:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152115328 00000100:00100000:2.0:1787853516.618148:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152114944 00000100:00100000:2.0:1787853516.618151:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152114944 00000100:00100000:2.0:1787853516.618169:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787853516.618176:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152115328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853516.618207:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152115328:12345-0@lo:400:kworker.0 Request processed in 32us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853516.618212:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787853516.618223:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787853516.618228:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152114944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853516.618255:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152114944:12345-0@lo:400:kworker.0 Request processed in 26us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853516.618260:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787853516.618278:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992743689680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1874700152115072:0@lo:400:kworker.0 00000100:00100000:2.0:1787853516.618301:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853516.618317:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152115584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853516.618340:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853516.618370:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152115584 00000100:00100000:2.0:1787853516.618374:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152115584 00000100:00100000:2.0:1787853516.618400:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787853516.618408:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152115584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853516.618434:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853516.618486:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152115584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853516.618491:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787853516.618537:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99275aa2a1c0 x1874700152115584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853516.618562:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152115584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853516.618761:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152115072 00000100:00100000:2.0:1787853516.618765:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152115072 00000100:00100000:2.0:1787853516.618784:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787853516.618789:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99275aa2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874700152115072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853516.618820:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99275aa2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874700152115072:12345-0@lo:400:kworker.0 Request processed in 31us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853516.618825:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787853516.618849:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992743689680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1874700152115072:0@lo:400:kworker.0 00000100:00080000:2.0:1787853516.618880:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787853516.618885:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787853516.618887:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787853516.618907:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99274368b0c0 x1874700152115200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853516.618916:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152115200:0@lo:400:kworker.0 00000100:00100000:2.0:1787853516.618924:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152114816:0@lo:400:kworker.0 00000100:00100000:2.0:1787853516.618932:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152115328:0@lo:400:kworker.0 00000100:00100000:0.0:1787853516.620763:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853516.620862:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992743689e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152114944:0@lo:400:kworker.0 00000100:00100000:1.0:1787853516.623495:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152115456 00000100:00100000:1.0:1787853516.623509:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152115456 00000100:00100000:1.0:1787853516.623573:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787853516.623583:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642107c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152115456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853516.623687:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642107c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152115456:12345-0@lo:400:kworker.0 Request processed in 93us (2917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853516.623694:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787853516.623755:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992775481e00 x1874700152115456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853516.623771:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992775481e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152115456:0@lo:400:kworker.0 00010000:00010000:2.0:1787853516.681919:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787853517.232704:0:8788:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1787853517.702964:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853518.725844:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853519.689426:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152115712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853519.689495:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853519.689605:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152115712 00000100:00100000:3.0:1787853519.689612:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152115712 00000100:00100000:3.0:1787853519.689691:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787853519.689701:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642104000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152115712:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787853519.689869:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787853519.689948:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853519.689998:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642104000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152115712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 299us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853519.690019:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1787853519.690141:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99276dac2940 x1874700152115712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853519.690170:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152115712:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787853519.755800:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853519.819143:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853519.819477:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853519.819524:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853519.819553:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853519.819577:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136357248 00000100:00100000:3.0:1787853519.819585:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136357248 00000100:00100000:3.0:1787853519.819640:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136357120 00000100:00100000:3.0:1787853519.819643:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136357120 00000100:00100000:3.0:1787853519.819663:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:3.0:1787853519.819700:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136357248:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787853519.819784:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136357248:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 112us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853519.819793:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:3.0:1787853519.819812:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:3.0:1787853519.819819:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136357120:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787853519.819847:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136357120:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 29us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853519.819853:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00080000:1.0:1787853519.823740:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787853519.823750:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787853519.823764:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136356864 00000100:00100000:1.0:1787853519.823773:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136356864 00000100:00100000:1.0:1787853519.823830:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 194 00000100:00100000:1.0:1787853519.823840:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2365:x1874700136356864:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853519.823923:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2365:x1874700136356864:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 84us (4399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853519.823932:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 194 00000100:00100000:0.0:1787853519.824482:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136356992 00000100:00100000:0.0:1787853519.824489:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136356992 00000100:00100000:0.0:1787853519.824729:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:0.0:1787853519.824740:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2365:x1874700136356992:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853519.824782:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2365:x1874700136356992:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 45us (5648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853519.824791:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00080000:1.0:1787853519.825099:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787853520.773970:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853521.733832:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787853521.733863:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761eabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152115840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853521.733899:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152115968:0@lo:400:kworker.0 00000100:00100000:2.0:1787853521.733924:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853521.733932:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853521.733979:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152116224:0@lo:400:kworker.0 00000100:00100000:0.0:1787853521.734099:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152116352:0@lo:400:kworker.0 00000100:00100000:3.0:1787853521.737213:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152115840 00000100:00100000:3.0:1787853521.737225:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152115840 00000100:00100000:3.0:1787853521.737309:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787853521.737320:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152115840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787853521.737354:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787853521.742734:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787853521.742786:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1874700152116480:0@lo:400:kworker.0 00000100:00100000:2.0:1787853521.743593:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853521.743659:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152115968 00000100:00100000:2.0:1787853521.743666:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152115968 00000100:00100000:2.0:1787853521.743734:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787853521.743744:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152115968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853521.743792:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152115968:12345-0@lo:400:kworker.0 Request processed in 50us (9858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853521.743799:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787853521.748007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853521.756076:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152115840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 18750us (22142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853521.756104:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787853521.756156:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152116096:0@lo:400:kworker.0 00000100:00100000:3.0:1787853521.756203:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853521.756231:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152116608:0@lo:400:kworker.0 00000100:00100000:3.0:1787853521.756255:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853521.758415:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152116352 00000100:00100000:3.0:1787853521.758430:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152116352 00000100:00100000:3.0:1787853521.758497:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152116608 00000100:00100000:3.0:1787853521.758501:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152116608 00000100:00100000:3.0:1787853521.758520:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787853521.758528:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9926421052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152116352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853521.760133:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9926421052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152116352:12345-0@lo:400:kworker.0 Request processed in 1599us (12127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853521.760146:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787853521.760178:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787853521.760189:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152116608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853521.760236:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152116608:12345-0@lo:400:kworker.0 Request processed in 50us (3978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853521.760242:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787853521.760433:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277bc3cb40 x1874700152116352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853521.760449:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152116352:0@lo:400:kworker.0 00000100:00100000:3.0:1787853521.762000:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152116224 00000100:00100000:3.0:1787853521.762010:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152116224 00000100:00100000:3.0:1787853521.762062:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152116096 00000100:00100000:3.0:1787853521.762066:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152116096 00000100:00100000:3.0:1787853521.762090:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787853521.762098:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761eab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152116224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853521.762161:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761eab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152116224:12345-0@lo:400:kworker.0 Request processed in 64us (18570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853521.762180:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787853521.762196:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787853521.762202:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152116096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853521.762234:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152116096:12345-0@lo:400:kworker.0 Request processed in 33us (6031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853521.762240:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787853521.762287:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152116096:0@lo:400:kworker.0 00010000:00080000:3.0:1787853521.763999:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277bc3e1c0 x1874700152116608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853521.764016:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152116608:0@lo:400:kworker.0 00000100:00100000:3.0:1787853521.764062:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152116224:0@lo:400:kworker.0 00010000:00080000:3.0:1787853521.764074:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992761eabc00 x1874700152115840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853521.764090:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761eabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152115840:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787853521.765514:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853521.765522:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853521.765557:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853521.765626:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152115968:0@lo:400:kworker.0 00000100:00100000:3.0:1787853521.765648:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152116480 00000100:00100000:3.0:1787853521.765655:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152116480 00000100:00080000:1.0:1787853521.765711:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853521.765819:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787853521.765829:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874700152116480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853521.766148:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874700152116480:12345-0@lo:400:kworker.0 Request processed in 320us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853521.766156:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787853521.766238:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1874700152116480:0@lo:400:kworker.0 00010000:00010000:2.0:1787853521.805642:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787853522.737242:0:9032:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing yml_node 00010000:00010000:0.0:1787853522.831874:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853523.847905:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853524.808847:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853524.808870:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152116736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853524.808939:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853524.809343:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152116736 00000100:00100000:3.0:1787853524.809352:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152116736 00000100:00100000:3.0:1787853524.809435:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787853524.809445:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642104b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152116736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787853524.809478:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853524.809531:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642104b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152116736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853524.809538:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1787853524.809580:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99276dac0f00 x1874700152116736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853524.809600:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152116736:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787853524.810073:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787853524.870000:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853524.924361:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853524.924410:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853524.924436:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136357376 00000100:00100000:2.0:1787853524.924448:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136357376 00000100:00100000:2.0:1787853524.924522:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 196 00000100:00100000:2.0:1787853524.924532:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2363:x1874700136357376:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853524.924618:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2363:x1874700136357376:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 87us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853524.924626:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 196 00000100:00100000:0.0:1787853524.925229:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136357504 00000100:00100000:0.0:1787853524.925235:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136357504 00000100:00100000:0.0:1787853524.925344:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:0.0:1787853524.925354:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2363:x1874700136357504:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853524.925413:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2363:x1874700136357504:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 60us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853524.925421:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00080000:1.0:1787853524.925476:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853524.931526:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853524.931576:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853524.931653:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136357632 00000100:00100000:2.0:1787853524.931663:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136357632 00000100:00100000:2.0:1787853524.931769:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136357760 00000100:00100000:2.0:1787853524.931773:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136357760 00000100:00100000:2.0:1787853524.931794:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:2.0:1787853524.931804:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2361:x1874700136357632:12345-192.168.206.10@tcp:9:kworker.0 00000020:00000080:2.0:1787853524.931838:0:6671:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb054848 00000100:00080000:2.0:1787853524.931847:0:6671:0:(import.c:65:import_set_state_nolock()) ffff99277bee1000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787853524.931895:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787853524.932242:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+2:2361:x1874700136357632:12345-192.168.206.10@tcp:9:kworker.0 Request processed in 439us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853524.932264:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:2.0:1787853524.932281:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:2.0:1787853524.932288:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2361:x1874700136357760:12345-192.168.206.10@tcp:9:kworker.0 00000020:00000080:2.0:1787853524.932305:0:6671:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb05484f 00000100:00080000:2.0:1787853524.932312:0:6671:0:(import.c:65:import_set_state_nolock()) ffff99277bee1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787853524.932334:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1787853524.932427:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853524.932433:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787853524.932603:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787853524.932607:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853524.932890:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+2:2361:x1874700136357760:12345-192.168.206.10@tcp:9:kworker.0 Request processed in 601us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853524.932899:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00010000:00010000:3.0:1787853525.894317:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853526.853872:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787853526.858724:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9926421061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152116992:0@lo:400:kworker.0 00000100:00100000:0.0:1787853526.858811:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853526.858863:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642106d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1874700152117504:0@lo:400:kworker.0 00000100:00100000:0.0:1787853526.858888:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853526.858916:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787853526.858921:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9926421070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152117120:0@lo:400:kworker.0 00000100:00100000:0.0:1787853526.858940:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853526.858956:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642105e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152117632:0@lo:400:kworker.0 00000100:00100000:0.0:1787853526.858980:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853526.859014:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152116992 00000100:00100000:0.0:1787853526.859021:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152116992 00000100:00100000:0.0:1787853526.859077:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787853526.859087:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152116992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853526.859136:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152116992:12345-0@lo:400:kworker.0 Request processed in 50us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853526.859154:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787853526.859190:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152117504 00000100:00100000:0.0:1787853526.859193:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152117504 00000100:00100000:0.0:1787853526.859226:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152117120 00000100:00100000:0.0:1787853526.860139:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152117120 00000100:00100000:0.0:1787853526.860197:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787853526.860207:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642104780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874700152117504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853526.860286:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642104780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874700152117504:12345-0@lo:400:kworker.0 Request processed in 80us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853526.860292:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787853526.860309:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787853526.860316:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642106940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152117120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853526.860345:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642106940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152117120:12345-0@lo:400:kworker.0 Request processed in 30us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853526.860351:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787853526.860374:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152117632 00000100:00100000:3.0:1787853526.860379:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152117632 00000100:00080000:0.0:1787853526.860385:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853526.860410:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642105680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152117376:0@lo:400:kworker.0 00000100:00100000:0.0:1787853526.860446:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853526.860447:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642107840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152117248:0@lo:400:kworker.0 00000100:00100000:2.0:1787853526.860479:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853526.860504:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152116864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853526.860529:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853526.860568:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152117248 00000100:00100000:2.0:1787853526.860572:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152117248 00000100:00100000:3.0:1787853526.860631:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152117376 00000100:00100000:3.0:1787853526.860635:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152117376 00000100:00100000:0.0:1787853526.860822:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9926421070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152117120:0@lo:400:kworker.0 00000100:00100000:0.0:1787853526.860836:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9926421061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152116992:0@lo:400:kworker.0 00000100:00100000:0.0:1787853526.860848:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642106d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1874700152117504:0@lo:400:kworker.0 00000100:00100000:2.0:1787853526.861083:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787853526.861091:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152117248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853526.861520:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787853526.861530:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642105a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152117632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853526.861590:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642105a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152117632:12345-0@lo:400:kworker.0 Request processed in 62us (2608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853526.861597:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787853526.861614:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1787853526.861619:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992642105e00 x1874700152117632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853526.861620:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9926421043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152117376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853526.861632:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642105e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152117632:0@lo:400:kworker.0 00000100:00100000:2.0:1787853526.861778:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152117248:12345-0@lo:400:kworker.0 Request processed in 686us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853526.861785:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787853526.861812:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152116864 00000100:00100000:2.0:1787853526.861817:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152116864 00000100:00100000:2.0:1787853526.861842:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787853526.861848:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761eabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152116864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853526.861888:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853526.861921:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761eabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152116864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853526.861927:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787853526.862800:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9926421043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152117376:12345-0@lo:400:kworker.0 Request processed in 1173us (2347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853526.862812:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787853526.862842:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787853526.862848:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787853526.862851:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787853526.862920:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992642105680 x1874700152117376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853526.862926:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642107840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152117248:0@lo:400:kworker.0 00000100:00100000:1.0:1787853526.862932:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642105680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152117376:0@lo:400:kworker.0 00010000:00080000:2.0:1787853526.862939:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99276dac30c0 x1874700152116864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853526.863810:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152116864:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787853526.919970:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787853526.990893:0:9223:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.83 00010000:00010000:0.0:1787853527.942232:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787853528.451761:0:7622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0d6ecd6d-a011-4e2a-a67c-6551aba162fe 00000020:00000080:0.0:1787853528.451774:0:7622:0:(genops.c:885:class_export_put()) final put ffff99277bee5800/0d6ecd6d-a011-4e2a-a67c-6551aba162fe 00000020:00000080:2.0:1787853528.456921:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99277bee5800/0d6ecd6d-a011-4e2a-a67c-6551aba162fe for lustre-OST0001 00000020:00000080:2.0:1787853528.457015:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99277bee1800 for lustre-OST0001 00000001:00100000:1.0:1787853528.466392:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0d6ecd6d-a011-4e2a-a67c-6551aba162fe 00000020:00000080:1.0:1787853528.466403:0:6697:0:(genops.c:885:class_export_put()) final put ffff99277bee4000/0d6ecd6d-a011-4e2a-a67c-6551aba162fe 00000020:00000080:0.0:1787853528.466505:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99277bee4000/0d6ecd6d-a011-4e2a-a67c-6551aba162fe for lustre-OST0000 00000020:00000080:0.0:1787853528.466564:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99277bee1000 for lustre-OST0000 00010000:00010000:3.0:1787853528.967081:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787853529.816277:0:9322:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.83 00000100:00100000:1.0:1787853529.935014:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787853529.935044:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9926421070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152117760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853529.935130:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853529.935252:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152117760 00000100:00100000:2.0:1787853529.935262:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152117760 00000100:00100000:2.0:1787853529.935345:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787853529.935355:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152117760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853529.935399:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853529.935448:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152117760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853529.935456:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787853529.935596:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9926421070c0 x1874700152117760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853529.935642:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9926421070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152117760:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787853529.937633:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787853529.993826:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853530.044360:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853530.044417:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853530.044452:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136358016 00000100:00100000:0.0:1787853530.044601:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136358016 00000100:00100000:2.0:1787853530.044958:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136357888 00000100:00100000:2.0:1787853530.044964:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136357888 00000100:00100000:0.0:1787853530.044972:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:0.0:1787853530.044987:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642104f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2364:x1874700136358016:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853530.045009:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 198 00000100:00100000:2.0:1787853530.045019:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2364:x1874700136357888:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853530.045376:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642104f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2364:x1874700136358016:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 391us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853530.045384:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00080000:0.0:1787853530.045415:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853530.045904:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2364:x1874700136357888:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 884us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853530.045914:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 198 00010000:00010000:0.0:1787853531.018097:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853531.974084:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152118016:0@lo:400:kworker.0 00000100:00100000:1.0:1787853531.974183:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853531.974295:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152118016 00000100:00100000:1.0:1787853531.974304:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152118016 00000100:00100000:1.0:1787853531.974360:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787853531.974370:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152118016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853531.974434:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152118016:12345-0@lo:400:kworker.0 Request processed in 64us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853531.974442:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787853531.974490:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152118016:0@lo:400:kworker.0 00000100:00100000:1.0:1787853531.974532:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1874700152118144:0@lo:400:kworker.0 00000100:00100000:1.0:1787853531.974560:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853531.974628:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152118528:0@lo:400:kworker.0 00000100:00100000:1.0:1787853531.974670:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853531.974734:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152118528 00000100:00100000:1.0:1787853531.974738:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152118528 00000100:00100000:1.0:1787853531.974781:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787853531.974789:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152118528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853531.974829:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152118528:12345-0@lo:400:kworker.0 Request processed in 41us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853531.974836:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787853531.974870:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277bc3d2c0 x1874700152118528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853531.974902:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152118528:0@lo:400:kworker.0 00000100:00100000:3.0:1787853531.975025:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152118272:0@lo:400:kworker.0 00000100:00100000:3.0:1787853531.975057:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853531.975078:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787853531.975085:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152117888:0@lo:400:kworker.0 00000100:00100000:3.0:1787853531.975114:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853531.975137:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152118400:0@lo:400:kworker.0 00000100:00100000:3.0:1787853531.975160:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853531.975185:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152117888 00000100:00100000:3.0:1787853531.975189:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152117888 00000100:00100000:3.0:1787853531.975216:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787853531.975222:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152117888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853531.975258:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152117888:12345-0@lo:400:kworker.0 Request processed in 36us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853531.975265:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787853531.975304:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152117888:0@lo:400:kworker.0 00000100:00100000:0.0:1787853531.975403:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152118144 00000100:00100000:0.0:1787853531.975408:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152118144 00000100:00100000:0.0:1787853531.975447:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152118400 00000100:00100000:0.0:1787853531.975451:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152118400 00000100:00100000:0.0:1787853531.975469:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787853531.975477:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874700152118144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853531.975523:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874700152118144:12345-0@lo:400:kworker.0 Request processed in 47us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853531.975530:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787853531.975544:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787853531.975550:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152118400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853531.975583:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152118400:12345-0@lo:400:kworker.0 Request processed in 33us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853531.975597:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1787853531.975621:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787853531.975627:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853531.975668:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1874700152118144:0@lo:400:kworker.0 00000100:00100000:0.0:1787853531.975812:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152118400:0@lo:400:kworker.0 00000100:00100000:1.0:1787853531.976782:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152118272 00000100:00100000:1.0:1787853531.976789:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152118272 00000100:00100000:1.0:1787853531.976849:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787853531.976858:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152118272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853531.976925:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152118272:12345-0@lo:400:kworker.0 Request processed in 69us (1866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853531.976932:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787853531.977043:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853531.977060:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152118656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853531.977104:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853531.977200:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152118656 00000100:00100000:1.0:1787853531.977205:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152118656 00010000:00080000:0.0:1787853531.977316:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277bc3c780 x1874700152118272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853531.977332:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152118272:0@lo:400:kworker.0 00000100:00100000:1.0:1787853531.977392:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787853531.977400:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274368a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152118656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787853531.977432:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853531.977479:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274368a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152118656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853531.977486:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787853531.977540:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99276dac30c0 x1874700152118656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853531.977555:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152118656:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787853531.977616:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787853532.038219:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787853532.565611:0:9419:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.83 00010000:00010000:0.0:1787853533.061909:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853534.088132:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787853534.213014:0:9469:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 13:58:52 EDT 2026 00000100:00100000:1.0:1787853535.046220:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787853535.046253:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9926421061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152118784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853535.046347:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853535.046518:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152118784 00000100:00100000:3.0:1787853535.046529:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152118784 00000100:00080000:0.0:1787853535.046695:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853535.046846:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787853535.046870:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152118784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787853535.046917:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853535.046990:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152118784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853535.046998:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787853535.047078:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9926421061c0 x1874700152118784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853535.047104:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9926421061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152118784:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787853535.109982:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853535.163170:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853535.163294:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853535.163379:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136358144 00000100:00100000:2.0:1787853535.163392:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136358144 00000100:00100000:2.0:1787853535.163473:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 200 00000100:00100000:2.0:1787853535.163485:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2363:x1874700136358144:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853535.163582:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2363:x1874700136358144:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 99us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853535.163592:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 200 00000100:00100000:0.0:1787853535.164407:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136358272 00000100:00100000:0.0:1787853535.164416:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136358272 00000100:00100000:0.0:1787853535.164494:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:0.0:1787853535.164503:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2363:x1874700136358272:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853535.164563:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2363:x1874700136358272:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 60us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853535.164587:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00080000:2.0:1787853535.166309:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787853536.147044:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853537.096635:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152119040:0@lo:400:kworker.0 00000100:00100000:2.0:1787853537.096747:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853537.096814:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152119552:0@lo:400:kworker.0 00000100:00100000:2.0:1787853537.096842:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853537.096875:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787853537.096882:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152119168:0@lo:400:kworker.0 00000100:00100000:2.0:1787853537.096905:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853537.096924:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9926421061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152119680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853537.096946:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853537.096982:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152119040 00000100:00100000:2.0:1787853537.096992:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152119040 00000100:00100000:2.0:1787853537.097044:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152119168 00000100:00100000:2.0:1787853537.097047:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152119168 00000100:00100000:2.0:1787853537.097077:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787853537.097086:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152119040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853537.097139:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152119040:12345-0@lo:400:kworker.0 Request processed in 54us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853537.097146:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787853537.097172:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787853537.097178:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152119168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853537.097207:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152119168:12345-0@lo:400:kworker.0 Request processed in 30us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853537.097213:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787853537.097233:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152119552 00000100:00100000:2.0:1787853537.097237:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152119552 00000100:00100000:2.0:1787853537.097269:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787853537.097276:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152119552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853537.097307:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152119552:12345-0@lo:400:kworker.0 Request processed in 32us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853537.097313:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787853537.097334:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152119680 00000100:00100000:2.0:1787853537.097337:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152119680 00000100:00100000:2.0:1787853537.097360:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787853537.097366:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152119680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853537.097399:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853537.097429:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152119680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853537.097435:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787853537.097454:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787853537.097458:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853537.097498:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152119168:0@lo:400:kworker.0 00010000:00080000:2.0:1787853537.097510:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9926421061c0 x1874700152119680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853537.097523:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9926421061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152119680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853537.097542:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152119040:0@lo:400:kworker.0 00010000:00080000:2.0:1787853537.097549:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277c7a61c0 x1874700152119552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853537.097556:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152119552:0@lo:400:kworker.0 00000100:00100000:3.0:1787853537.097696:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992743689e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152119296:0@lo:400:kworker.0 00000100:00100000:3.0:1787853537.097733:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853537.097762:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787853537.097768:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992743689680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152118912:0@lo:400:kworker.0 00000100:00100000:3.0:1787853537.097797:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853537.097828:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152119424:0@lo:400:kworker.0 00000100:00100000:3.0:1787853537.097852:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853537.098182:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152119296 00000100:00100000:2.0:1787853537.098188:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152119296 00000100:00100000:2.0:1787853537.098236:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787853537.098245:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152119296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853537.098297:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152119296:12345-0@lo:400:kworker.0 Request processed in 53us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853537.098304:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1787853537.098336:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992743689e00 x1874700152119296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853537.098349:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992743689e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152119296:0@lo:400:kworker.0 00000100:00100000:2.0:1787853537.098371:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152119424 00000100:00100000:2.0:1787853537.098374:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152119424 00000100:00100000:2.0:1787853537.098402:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787853537.098409:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992760d7cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152119424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853537.098443:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992760d7cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152119424:12345-0@lo:400:kworker.0 Request processed in 35us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853537.098449:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787853537.098476:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152119424:0@lo:400:kworker.0 00000100:00080000:3.0:1787853537.098528:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787853537.098533:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853537.099765:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152118912 00000100:00100000:2.0:1787853537.099776:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152118912 00000100:00100000:2.0:1787853537.099849:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787853537.099858:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152118912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853537.099954:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152118912:12345-0@lo:400:kworker.0 Request processed in 97us (2154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853537.099961:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787853537.100078:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992743689680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152118912:0@lo:400:kworker.0 00010000:00010000:0.0:1787853537.159976:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853538.186306:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853539.205818:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853540.167688:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992760d7d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152119808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853540.167754:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853540.167834:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152119808 00000100:00100000:3.0:1787853540.167841:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152119808 00000100:00100000:3.0:1787853540.167896:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787853540.167906:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152119808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787853540.167952:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853540.167997:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152119808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853540.168004:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787853540.168026:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787853540.168226:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992760d7d2c0 x1874700152119808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853540.168245:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992760d7d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152119808:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787853540.232439:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853540.284492:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853540.284700:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853540.284727:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136358528 00000100:00100000:0.0:1787853540.284735:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136358528 00000100:00100000:0.0:1787853540.284787:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:0.0:1787853540.284797:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9926421061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2362:x1874700136358528:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853540.284867:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9926421061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2362:x1874700136358528:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 71us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853540.284876:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00080000:0.0:1787853540.284897:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853540.285053:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136358400 00000100:00100000:2.0:1787853540.285058:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136358400 00000100:00100000:2.0:1787853540.285093:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 202 00000100:00100000:2.0:1787853540.285101:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2362:x1874700136358400:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853540.285131:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2362:x1874700136358400:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 32us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853540.285138:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 202 00010000:00010000:3.0:1787853541.259930:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853542.214053:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152120064:0@lo:400:kworker.0 00000100:00100000:2.0:1787853542.214136:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853542.214204:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152120576:0@lo:400:kworker.0 00000100:00100000:2.0:1787853542.215029:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853542.215138:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853542.215147:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152120192:0@lo:400:kworker.0 00000100:00100000:2.0:1787853542.215183:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853542.215222:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152120064 00000100:00100000:2.0:1787853542.215229:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152120064 00000100:00100000:2.0:1787853542.216023:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152120192 00000100:00100000:2.0:1787853542.216029:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152120192 00000100:00100000:3.0:1787853542.216173:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152119936:0@lo:400:kworker.0 00000100:00100000:3.0:1787853542.216217:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853542.216258:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152120448:0@lo:400:kworker.0 00000100:00100000:3.0:1787853542.216283:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853542.216298:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787853542.216304:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152120320:0@lo:400:kworker.0 00000100:00100000:3.0:1787853542.216326:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853542.216359:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152119936 00000100:00100000:3.0:1787853542.216363:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152119936 00000100:00100000:3.0:1787853542.216392:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787853542.216400:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3300:x1874700152119936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853542.216451:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3300:x1874700152119936:12345-0@lo:400:kworker.0 Request processed in 51us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853542.216457:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787853542.216488:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152120576 00000100:00100000:3.0:1787853542.216492:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152120576 00000100:00100000:3.0:1787853542.216531:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152120320 00000100:00100000:3.0:1787853542.216535:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152120320 00000100:00100000:3.0:1787853542.216551:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787853542.216557:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152120576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853542.216608:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152120576:12345-0@lo:400:kworker.0 Request processed in 50us (2377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853542.216614:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787853542.216627:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787853542.216632:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152120320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853542.216660:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152120320:12345-0@lo:400:kworker.0 Request processed in 28us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853542.216665:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1787853542.216724:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277c7a5a40 x1874700152120320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853542.216736:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152120320:0@lo:400:kworker.0 00000100:00100000:3.0:1787853542.216745:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152119936:0@lo:400:kworker.0 00010000:00080000:3.0:1787853542.216774:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277c7a4f00 x1874700152120576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853542.216784:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152120576:0@lo:400:kworker.0 00000100:00100000:2.0:1787853542.216978:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787853542.216991:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152120064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853542.217030:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152120064:12345-0@lo:400:kworker.0 Request processed in 43us (2895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853542.217044:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787853542.217056:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152120448 00000100:00100000:3.0:1787853542.217171:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152120064:0@lo:400:kworker.0 00000100:00100000:2.0:1787853542.217212:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152120448 00000100:00080000:1.0:1787853542.217337:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787853542.217342:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787853542.217351:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853542.217365:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787853542.217373:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152120192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853542.217421:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152120192:12345-0@lo:400:kworker.0 Request processed in 49us (2236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853542.217427:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787853542.217440:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787853542.217447:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152120448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853542.217478:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152120448:12345-0@lo:400:kworker.0 Request processed in 31us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853542.217483:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787853542.217610:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152120448:0@lo:400:kworker.0 00000100:00100000:3.0:1787853542.217639:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152120192:0@lo:400:kworker.0 00000100:00100000:3.0:1787853542.218369:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853542.218389:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642106d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152120704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853542.218427:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853542.218555:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152120704 00000100:00100000:0.0:1787853542.218561:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152120704 00000100:00100000:0.0:1787853542.218611:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787853542.218620:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152120704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787853542.218648:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853542.218718:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152120704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853542.218725:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787853542.218818:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992642106d00 x1874700152120704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853542.218835:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642106d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152120704:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787853542.280454:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853543.301830:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853544.326092:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853545.288505:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853545.288533:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642105680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152120832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853545.288634:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853545.288742:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152120832 00000100:00100000:0.0:1787853545.288750:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152120832 00000100:00100000:0.0:1787853545.288813:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787853545.288823:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642105e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152120832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787853545.288866:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853545.288914:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642105e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152120832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853545.288922:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787853545.288971:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992642105680 x1874700152120832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853545.288992:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642105680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152120832:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787853545.289144:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787853545.351451:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853545.402418:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853545.402480:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853545.402516:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136358784 00000100:00100000:1.0:1787853545.402532:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136358784 00000100:00100000:1.0:1787853545.402626:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:1.0:1787853545.402638:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642107840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2362:x1874700136358784:12345-192.168.206.10@tcp:400:kworker.0 00000100:00080000:3.0:1787853545.402664:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853545.402775:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642107840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2362:x1874700136358784:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 138us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853545.402786:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:2.0:1787853545.404280:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136358656 00000100:00100000:2.0:1787853545.404296:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136358656 00000100:00100000:3.0:1787853545.404878:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 204 00000100:00100000:3.0:1787853545.404892:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2362:x1874700136358656:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787853545.404992:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2362:x1874700136358656:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 103us (2511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853545.405000:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 204 00010000:00010000:0.0:1787853546.377860:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853547.333914:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152121088:0@lo:400:kworker.0 00000100:00100000:3.0:1787853547.333984:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853547.334060:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853547.334067:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152121216:0@lo:400:kworker.0 00000100:00100000:3.0:1787853547.334094:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853547.334127:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152121088 00000100:00100000:3.0:1787853547.334134:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152121088 00000100:00100000:3.0:1787853547.334178:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787853547.334186:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152121088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853547.334233:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152121088:12345-0@lo:400:kworker.0 Request processed in 47us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853547.334240:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787853547.334271:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152121216 00000100:00100000:3.0:1787853547.334275:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152121216 00000100:00100000:3.0:1787853547.334298:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787853547.334304:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992760d7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152121216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853547.334333:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992760d7d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152121216:12345-0@lo:400:kworker.0 Request processed in 29us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853547.334354:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787853547.334395:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152121216:0@lo:400:kworker.0 00000100:00100000:3.0:1787853547.334405:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152121088:0@lo:400:kworker.0 00000100:00100000:1.0:1787853547.334659:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642105680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152120960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853547.334734:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853547.334879:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152120960 00000100:00100000:3.0:1787853547.334883:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152120960 00000100:00100000:3.0:1787853547.334920:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787853547.334927:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152120960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787853547.334953:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853547.335409:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152121344:0@lo:400:kworker.0 00000100:00100000:0.0:1787853547.335455:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853547.335498:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152121344 00000100:00100000:0.0:1787853547.335502:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152121344 00000100:00100000:0.0:1787853547.335533:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787853547.335541:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152121344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853547.335590:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152121344:12345-0@lo:400:kworker.0 Request processed in 49us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853547.335596:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787853547.335631:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152121344:0@lo:400:kworker.0 00000100:00100000:2.0:1787853547.336344:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787853547.336357:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1874700152121600:0@lo:400:kworker.0 00000100:00100000:2.0:1787853547.336418:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853547.336464:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152121600 00000100:00100000:2.0:1787853547.336469:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152121600 00000100:00100000:2.0:1787853547.336502:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787853547.336509:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874700152121600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853547.336549:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874700152121600:12345-0@lo:400:kworker.0 Request processed in 40us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853547.336555:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787853547.336596:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1874700152121600:0@lo:400:kworker.0 00000100:00080000:2.0:1787853547.336631:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787853547.336635:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853547.336975:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787853547.336985:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152121472:0@lo:400:kworker.0 00000100:00100000:0.0:1787853547.337030:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853547.338405:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152120960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3472us (3664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853547.338428:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1787853547.338592:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992642105680 x1874700152120960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853547.338614:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642105680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152120960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853547.338717:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152121472 00000100:00100000:2.0:1787853547.338724:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152121472 00000100:00100000:2.0:1787853547.338789:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787853547.338798:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642106580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152121472:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787853547.338848:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853547.338883:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642106580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152121472:12345-0@lo:400:kworker.0 Request processed in 87us (1852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853547.338892:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787853547.338919:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277c7a6940 x1874700152121472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853547.338931:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152121472:0@lo:400:kworker.0 00010000:00010000:2.0:1787853547.397977:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853548.422344:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787853549.300966:0:10101:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 13:59:07 (1787853547) === 00010000:00010000:2.0:1787853549.448444:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853549.714518:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853549.714705:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136358912 00000100:00100000:0.0:1787853549.714717:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136358912 00000100:00100000:0.0:1787853549.714796:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 206 00000100:00100000:0.0:1787853549.714808:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+10:8131:x1874700136358912:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787853549.714829:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853549.714851:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992740031400/0xcf1365f7cb054913 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1ebf expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853549.714886:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992740031400/0xcf1365f7cb054913 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ebf expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853549.714900:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992740031400/0xcf1365f7cb054913 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ebf expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853549.714911:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992740031400, rc 0) 00000100:00100000:0.0:1787853549.714991:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+11:8131:x1874700136358912:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 185us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853549.714999:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 206 00000100:00100000:1.0:1787853549.724736:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853549.724973:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136359040 00000100:00100000:3.0:1787853549.724986:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136359040 00000100:00100000:3.0:1787853549.725067:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 207 00000100:00100000:3.0:1787853549.725081:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+11:8131:x1874700136359040:12345-192.168.206.10@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787853549.726653:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+11:8131:x1874700136359040:12345-192.168.206.10@tcp:501:mount.lustre.0 Request processed in 1557us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853549.726667:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 207 00000100:00100000:2.0:1787853549.734781:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853549.734898:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136359168 00000100:00100000:1.0:1787853549.734930:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136359168 00000100:00100000:1.0:1787853549.735055:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 208 00000100:00100000:1.0:1787853549.735068:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+11:8131:x1874700136359168:12345-192.168.206.10@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787853549.735600:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+11:8131:x1874700136359168:12345-192.168.206.10@tcp:503:mount.lustre.0 Request processed in 531us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853549.735609:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 208 00000100:00100000:1.0:1787853549.741497:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853549.744261:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136359296 00000100:00100000:3.0:1787853549.744294:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136359296 00000100:00100000:3.0:1787853549.744385:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 209 00000100:00100000:3.0:1787853549.744397:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+11:8135:x1874700136359296:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787853549.744832:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+11:8135:x1874700136359296:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 437us (3347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853549.744841:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 209 00000100:00100000:2.0:1787853549.764784:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853549.770716:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136359424 00000100:00100000:1.0:1787853549.770736:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136359424 00000100:00100000:1.0:1787853549.770831:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 210 00000100:00100000:1.0:1787853549.770844:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+11:8135:x1874700136359424:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787853549.771284:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+11:8135:x1874700136359424:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 441us (6514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853549.771293:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 210 00000100:00100000:2.0:1787853549.783424:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853549.783510:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136359552 00000100:00100000:0.0:1787853549.783538:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136359552 00000100:00100000:0.0:1787853549.783629:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 211 00000100:00100000:0.0:1787853549.783642:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+11:8131:x1874700136359552:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787853549.783664:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853549.783725:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992740031600/0xcf1365f7cb05491a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1ee9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853549.783760:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992740031600/0xcf1365f7cb05491a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ee9 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853549.783777:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992740031600/0xcf1365f7cb05491a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ee9 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853549.783789:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992740031600, rc 0) 00000100:00100000:0.0:1787853549.784072:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+12:8131:x1874700136359552:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 432us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853549.784080:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 211 00000100:00100000:2.0:1787853549.788361:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853549.802435:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136359680 00000100:00100000:3.0:1787853549.802457:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136359680 00000100:00100000:3.0:1787853549.802790:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 212 00000100:00100000:3.0:1787853549.802806:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+12:8131:x1874700136359680:12345-192.168.206.10@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787853549.802842:0:5819:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787853549.802871:0:5819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787853549.802876:0:5819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787853549.802880:0:5819:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787853549.802883:0:5819:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787853549.812030:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+12:8131:x1874700136359680:12345-192.168.206.10@tcp:256:mount.lustre.0 Request processed in 9211us (23666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853549.812050:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 212 00000100:00100000:2.0:1787853549.816920:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853549.817106:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136359808 00000100:00100000:0.0:1787853549.817119:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136359808 00000100:00100000:0.0:1787853549.817193:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 213 00000100:00100000:0.0:1787853549.817205:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+12:8131:x1874700136359808:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787853549.817226:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853549.817250:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992740030400/0xcf1365f7cb054921 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1ef0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853549.817286:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992740030400/0xcf1365f7cb054921 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ef0 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853549.817300:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992740030400/0xcf1365f7cb054921 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ef0 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853549.817331:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992740030400, rc 0) 00000100:00100000:0.0:1787853549.817423:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:8131:x1874700136359808:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 219us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853549.817431:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 213 00000100:00100000:2.0:1787853549.823154:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853549.825605:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136359936 00000100:00100000:3.0:1787853549.825626:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136359936 00000100:00100000:3.0:1787853549.825755:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 214 00000100:00100000:3.0:1787853549.825768:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+13:8131:x1874700136359936:12345-192.168.206.10@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787853549.826164:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+13:8131:x1874700136359936:12345-192.168.206.10@tcp:501:mount.lustre.0 Request processed in 397us (3025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853549.826174:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 214 00000100:00100000:2.0:1787853549.832305:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853549.832415:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136360064 00000100:00100000:3.0:1787853549.832429:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136360064 00000100:00100000:3.0:1787853549.832550:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 215 00000100:00100000:3.0:1787853549.832571:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:8131:x1874700136360064:12345-192.168.206.10@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787853549.832924:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:8131:x1874700136360064:12345-192.168.206.10@tcp:503:mount.lustre.0 Request processed in 354us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853549.832935:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 215 00000100:00100000:2.0:1787853549.839562:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853549.839870:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136360192 00000100:00100000:0.0:1787853549.839884:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136360192 00000100:00100000:0.0:1787853549.839969:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 216 00000100:00100000:0.0:1787853549.839982:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:8139:x1874700136360192:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787853549.843080:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:8139:x1874700136360192:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 3084us (3542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853549.843097:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 216 00000100:00100000:2.0:1787853549.849035:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853549.850879:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136360320 00000100:00100000:3.0:1787853549.850900:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136360320 00000100:00100000:3.0:1787853549.850986:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 217 00000100:00100000:3.0:1787853549.850998:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:8139:x1874700136360320:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787853549.851322:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:8139:x1874700136360320:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 324us (2300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853549.851331:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 217 00000100:00100000:1.0:1787853549.866620:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853549.866719:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853549.866814:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136360832 00000100:00100000:0.0:1787853549.866827:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136360832 00000100:00100000:0.0:1787853549.866915:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136360448 00000100:00100000:0.0:1787853549.866919:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136360448 00000100:00100000:0.0:1787853549.866943:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:0.0:1787853549.866955:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2364:x1874700136360832:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853549.867048:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2364:x1874700136360832:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 95us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853549.867057:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:0.0:1787853549.867088:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:0.0:1787853549.867094:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2361:x1874700136360448:12345-192.168.206.10@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787853549.867169:0:5825:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from bcff1eac-63bd-47ee-ba0c-e172aa18acea@192.168.206.10@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:0.0:1787853549.867217:0:5825:0:(genops.c:1385:class_connect()) connect: client bcff1eac-63bd-47ee-ba0c-e172aa18acea, cookie 0xcf1365f7cb054928 00000100:00080000:3.0:1787853549.867241:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00100000:0.0:1787853549.867254:0:5825:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787853549.867744:0:5825:0:(import.c:65:import_set_state_nolock()) ffff99277c199800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853549.867793:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:2361:x1874700136360448:12345-192.168.206.10@tcp:38:mount.lustre.0 Request processed in 696us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853549.867818:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:1.0:1787853549.877807:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853549.877861:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853549.877937:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136360704 00000100:00100000:0.0:1787853549.877957:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136360704 00000100:00100000:0.0:1787853549.878038:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136360576 00000100:00100000:0.0:1787853549.878041:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136360576 00000100:00100000:0.0:1787853549.878066:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:0.0:1787853549.878075:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcff1eac-63bd-47ee-ba0c-e172aa18acea+7:8131:x1874700136360704:12345-192.168.206.10@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787853549.878127:0:5825:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787853549.878226:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcff1eac-63bd-47ee-ba0c-e172aa18acea+7:8131:x1874700136360704:12345-192.168.206.10@tcp:41:mount.lustre.0 Request processed in 152us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853549.878234:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:0.0:1787853549.878254:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:0.0:1787853549.878260:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:0:x1874700136360576:12345-192.168.206.10@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787853549.878270:0:5825:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787853549.878291:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:0:x1874700136360576:12345-192.168.206.10@tcp:41:mount.lustre.0 Request processed in 31us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853549.878296:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00080000:2.0:1787853549.878613:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853549.890602:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853549.890720:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136360960 00000100:00100000:0.0:1787853549.890733:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136360960 00000100:00100000:0.0:1787853549.890794:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:0.0:1787853549.890804:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:8131:x1874700136360960:12345-192.168.206.10@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787853549.890914:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:8131:x1874700136360960:12345-192.168.206.10@tcp:40:mount.lustre.0 Request processed in 111us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853549.890923:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:0.0:1787853549.896786:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853549.896846:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853549.896944:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136361088 00000100:00100000:1.0:1787853549.896957:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136361088 00000100:00100000:1.0:1787853549.897012:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136361216 00000100:00100000:1.0:1787853549.897015:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136361216 00000100:00100000:1.0:1787853549.897031:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:1.0:1787853549.897040:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642106d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1874700136361088:12345-192.168.206.10@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787853549.897080:0:6673:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from bcff1eac-63bd-47ee-ba0c-e172aa18acea@192.168.206.10@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:1.0:1787853549.897125:0:6673:0:(genops.c:1385:class_connect()) connect: client bcff1eac-63bd-47ee-ba0c-e172aa18acea, cookie 0xcf1365f7cb05492f 00002000:00100000:1.0:1787853549.897147:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bcff1eac-63bd-47ee-ba0c-e172aa18acea/ffff99276f6b4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113953 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787853549.897178:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787853549.897470:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787853549.897510:0:6673:0:(import.c:65:import_set_state_nolock()) ffff99276f6b1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787853549.897610:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642106d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:2361:x1874700136361088:12345-192.168.206.10@tcp:8:mount.lustre.0 Request processed in 570us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853549.897620:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:1.0:1787853549.897644:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:1.0:1787853549.897649:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9926421070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1874700136361216:12345-192.168.206.10@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787853549.897667:0:6673:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from bcff1eac-63bd-47ee-ba0c-e172aa18acea@192.168.206.10@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:1.0:1787853549.897728:0:6673:0:(genops.c:1385:class_connect()) connect: client bcff1eac-63bd-47ee-ba0c-e172aa18acea, cookie 0xcf1365f7cb054936 00002000:00100000:1.0:1787853549.897735:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bcff1eac-63bd-47ee-ba0c-e172aa18acea/ffff99276f6b6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113953 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787853549.897753:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787853549.897891:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787853549.897906:0:6673:0:(import.c:65:import_set_state_nolock()) ffff99276f6b6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787853549.897933:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9926421070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:2361:x1874700136361216:12345-192.168.206.10@tcp:8:mount.lustre.0 Request processed in 282us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853549.897941:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:2.0:1787853549.903503:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853549.903725:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136361344 00000100:00100000:3.0:1787853549.903738:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136361344 00000100:00100000:3.0:1787853549.903813:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:3.0:1787853549.903824:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:8131:x1874700136361344:12345-192.168.206.10@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787853549.904159:0:5827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787853549.904335:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:8131:x1874700136361344:12345-192.168.206.10@tcp:33:mount.lustre.0 Request processed in 512us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853549.904344:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:3.0:1787853550.406073:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853550.406105:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642105680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152121728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853550.406201:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853550.406642:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152121728 00000100:00100000:0.0:1787853550.406652:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152121728 00000100:00080000:2.0:1787853550.406769:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853550.406770:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787853550.406788:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152121728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787853550.406817:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853550.406876:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152121728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853550.406884:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787853550.407001:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992642105680 x1874700152121728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853550.407030:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642105680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152121728:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787853550.469969:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853551.501247:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853552.460604:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152121856:0@lo:400:kworker.0 00000100:00100000:3.0:1787853552.460715:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853552.460781:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152122368:0@lo:400:kworker.0 00000100:00100000:3.0:1787853552.460812:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853552.460840:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787853552.460846:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152121984:0@lo:400:kworker.0 00000100:00100000:3.0:1787853552.460869:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853552.460886:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152122496:0@lo:400:kworker.0 00000100:00100000:3.0:1787853552.460909:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853552.460936:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152122240:0@lo:400:kworker.0 00000100:00100000:3.0:1787853552.460960:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853552.460979:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787853552.460985:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1874700152122112:0@lo:400:kworker.0 00000100:00100000:3.0:1787853552.461005:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853552.461872:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152122624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853552.461915:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853552.461970:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152122624 00000100:00100000:2.0:1787853552.461979:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152122624 00000100:00100000:3.0:1787853552.463354:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152121856 00000100:00100000:3.0:1787853552.463366:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152121856 00000100:00100000:3.0:1787853552.463421:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787853552.463430:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152121856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853552.463518:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152121856:12345-0@lo:400:kworker.0 Request processed in 89us (2804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853552.463526:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787853552.463578:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152122368 00000100:00100000:3.0:1787853552.463583:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152122368 00000100:00100000:3.0:1787853552.463618:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152121984 00000100:00100000:3.0:1787853552.463621:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152121984 00000100:00100000:3.0:1787853552.463633:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152122112 00000100:00100000:3.0:1787853552.463636:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152122112 00000100:00100000:3.0:1787853552.463651:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787853552.463657:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152122368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853552.463724:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152122368:12345-0@lo:400:kworker.0 Request processed in 66us (2910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853552.463731:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787853552.463745:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787853552.463751:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152121984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853552.463780:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152121984:12345-0@lo:400:kworker.0 Request processed in 29us (2910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853552.463786:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787853552.463798:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787853552.463803:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874700152122112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853552.463830:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874700152122112:12345-0@lo:400:kworker.0 Request processed in 27us (2824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853552.463835:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787853552.463858:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152122496 00000100:00100000:3.0:1787853552.463862:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152122496 00000100:00100000:3.0:1787853552.463887:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152122240 00000100:00100000:3.0:1787853552.463890:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152122240 00000100:00100000:3.0:1787853552.463905:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787853552.463910:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1874700152122496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853552.463941:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1874700152122496:12345-0@lo:400:kworker.0 Request processed in 31us (3032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853552.463947:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787853552.463958:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787853552.463963:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152122240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853552.463989:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152122240:12345-0@lo:400:kworker.0 Request processed in 26us (3029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853552.464004:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787853552.464141:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787853552.464153:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152122624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853552.464187:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853552.464230:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152122624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (2314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853552.464237:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787853552.464258:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787853552.464263:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787853552.464265:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787853552.464304:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277c7a5e00 x1874700152122624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853552.464329:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152122624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853552.464907:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1874700152122112:0@lo:400:kworker.0 00010000:00080000:3.0:1787853552.464922:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992747b4f840 x1874700152122240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853552.464933:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152122240:0@lo:400:kworker.0 00000100:00100000:3.0:1787853552.464993:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152121984:0@lo:400:kworker.0 00010000:00080000:3.0:1787853552.465004:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992747b4ed00 x1874700152122496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853552.465013:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152122496:0@lo:400:kworker.0 00000100:00100000:3.0:1787853552.465023:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152121856:0@lo:400:kworker.0 00000100:00100000:3.0:1787853552.465035:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152122368:0@lo:400:kworker.0 00010000:00010000:1.0:1787853552.518051:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853553.542163:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787853554.064920:0:7622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bcff1eac-63bd-47ee-ba0c-e172aa18acea 00000001:00100000:1.0:1787853554.070207:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bcff1eac-63bd-47ee-ba0c-e172aa18acea 00010000:00010000:1.0:1787853554.575701:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787853554.596661:0:5846:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bcff1eac-63bd-47ee-ba0c-e172aa18acea 00000100:00100000:2.0:1787853555.132045:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853555.132086:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853555.132358:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136361472 00000100:00100000:1.0:1787853555.132371:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136361472 00000100:00100000:1.0:1787853555.132464:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 219 00000100:00100000:1.0:1787853555.132475:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2365:x1874700136361472:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853555.132581:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2365:x1874700136361472:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 107us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853555.132590:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 219 00000100:00100000:2.0:1787853555.132833:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853555.132862:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853555.132961:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853555.132988:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136361728 00000100:00100000:2.0:1787853555.132992:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136361728 00000100:00100000:2.0:1787853555.133039:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136361600 00000100:00100000:2.0:1787853555.133042:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136361600 00000100:00100000:2.0:1787853555.133070:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:2.0:1787853555.133078:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2365:x1874700136361728:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853555.133125:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2365:x1874700136361728:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 48us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853555.133142:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:2.0:1787853555.133157:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:2.0:1787853555.133164:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2365:x1874700136361600:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853555.133195:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2365:x1874700136361600:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 31us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853555.133201:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:2.0:1787853555.133220:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136361984 00000100:00100000:2.0:1787853555.133224:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136361984 00000100:00100000:2.0:1787853555.133985:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136361856 00000100:00100000:2.0:1787853555.133990:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136361856 00000100:00100000:2.0:1787853555.134020:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:2.0:1787853555.134029:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2365:x1874700136361984:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853555.134072:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2365:x1874700136361984:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 45us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853555.134079:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:2.0:1787853555.134093:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:2.0:1787853555.134099:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2365:x1874700136361856:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853555.134124:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2365:x1874700136361856:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 26us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853555.134131:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00080000:2.0:1787853555.134159:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787853555.134165:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787853555.134168:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853555.531760:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152122752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853555.531858:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853555.532038:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152122752 00000100:00100000:0.0:1787853555.532049:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152122752 00000100:00100000:0.0:1787853555.532116:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787853555.532125:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152122752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787853555.532171:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853555.532229:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152122752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853555.532619:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1787853555.532647:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787853555.532915:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277bc3e940 x1874700152122752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853555.532942:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152122752:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787853555.550997:0:10296:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1787853555.589921:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853556.617476:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853557.574205:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853557.574240:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152122880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853557.574493:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853557.574776:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787853557.574790:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152123008:0@lo:400:kworker.0 00000100:00100000:3.0:1787853557.574833:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853557.574859:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152122880 00000100:00100000:1.0:1787853557.574869:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152122880 00000100:00100000:1.0:1787853557.574943:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787853557.574953:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152122880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787853557.574997:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853557.575169:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152123008 00000100:00100000:0.0:1787853557.575192:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152123008 00000100:00100000:0.0:1787853557.575239:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787853557.575247:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152123008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853557.575291:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152123008:12345-0@lo:400:kworker.0 Request processed in 44us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853557.575299:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787853557.575382:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152123008:0@lo:400:kworker.0 00000100:00080000:3.0:1787853557.576331:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853557.576384:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152123136:0@lo:400:kworker.0 00000100:00100000:0.0:1787853557.576467:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853557.576529:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853557.576537:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152123264:0@lo:400:kworker.0 00000100:00100000:0.0:1787853557.576562:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853557.576606:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152123136 00000100:00100000:0.0:1787853557.576613:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152123136 00000100:00100000:0.0:1787853557.576656:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152123264 00000100:00100000:0.0:1787853557.576659:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152123264 00000100:00100000:0.0:1787853557.576724:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787853557.576732:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152123136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853557.576791:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152123136:12345-0@lo:400:kworker.0 Request processed in 59us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853557.576799:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787853557.576814:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787853557.576820:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748384b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152123264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853557.576848:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748384b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152123264:12345-0@lo:400:kworker.0 Request processed in 28us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853557.576854:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1787853557.576885:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853557.576897:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152123392:0@lo:400:kworker.0 00000100:00100000:0.0:1787853557.576929:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853557.576966:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152123392 00000100:00100000:0.0:1787853557.576969:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152123392 00000100:00100000:0.0:1787853557.577010:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787853557.577017:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748386580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152123392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853557.577591:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748386580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152123392:12345-0@lo:400:kworker.0 Request processed in 573us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853557.577599:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787853557.577605:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152122880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2650us (3109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853557.577622:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1787853557.577626:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853557.577665:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152123264:0@lo:400:kworker.0 00000100:00100000:0.0:1787853557.577701:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152123136:0@lo:400:kworker.0 00010000:00080000:1.0:1787853557.577729:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277c7a52c0 x1874700152122880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853573 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853557.577752:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152122880:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787853557.577876:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99275aa2a1c0 x1874700152123392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853557.577888:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152123392:0@lo:400:kworker.0 00000100:00100000:3.0:1787853557.578126:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787853557.578319:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152123520:0@lo:400:kworker.0 00000100:00100000:3.0:1787853557.578591:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853557.578752:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152123520 00000100:00100000:0.0:1787853557.578759:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152123520 00000100:00100000:0.0:1787853557.578863:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787853557.578872:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152123520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853557.578929:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152123520:12345-0@lo:400:kworker.0 Request processed in 58us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853557.578936:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787853557.579017:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152123520:0@lo:400:kworker.0 00000100:00080000:2.0:1787853557.579177:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787853557.638212:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853558.663630:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853559.686734:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853560.249922:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853560.249966:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853560.249988:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853560.250009:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853560.250032:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853560.250056:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136362112 00000100:00100000:1.0:1787853560.250064:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136362112 00000100:00100000:1.0:1787853560.250113:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 221 00000100:00100000:1.0:1787853560.250122:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2362:x1874700136362112:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853560.250182:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2362:x1874700136362112:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 61us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853560.250190:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 221 00000100:00100000:1.0:1787853560.250221:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136362240 00000100:00100000:1.0:1787853560.250224:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136362240 00000100:00100000:1.0:1787853560.250255:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136362368 00000100:00100000:1.0:1787853560.250258:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136362368 00000100:00100000:1.0:1787853560.250277:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 70 00000100:00100000:1.0:1787853560.250284:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2363:x1874700136362240:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853560.250313:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2363:x1874700136362240:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 29us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853560.250320:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 70 00000100:00100000:1.0:1787853560.250331:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00100000:1.0:1787853560.250337:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775481e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2362:x1874700136362368:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853560.250357:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775481e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2362:x1874700136362368:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 21us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853560.250363:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00100000:1.0:1787853560.250380:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136362624 00000100:00100000:1.0:1787853560.250384:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136362624 00000100:00100000:1.0:1787853560.250411:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136362496 00000100:00100000:1.0:1787853560.250414:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136362496 00000100:00100000:1.0:1787853560.250428:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:1.0:1787853560.250433:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c2030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2362:x1874700136362624:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853560.250458:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c2030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2362:x1874700136362624:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 25us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853560.250470:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:1.0:1787853560.250482:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:1.0:1787853560.250487:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c203840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2363:x1874700136362496:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853560.250524:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c203840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2363:x1874700136362496:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 36us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853560.250530:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00080000:1.0:1787853560.250697:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787853560.250701:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787853560.250704:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853560.648882:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927483861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152123648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853560.648952:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853560.649297:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152123648 00000100:00100000:1.0:1787853560.649305:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152123648 00000100:00100000:1.0:1787853560.649371:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787853560.649380:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99275aa2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152123648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787853560.649412:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787853560.649482:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853560.652753:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99275aa2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152123648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3364us (3790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853560.652769:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1787853560.658761:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9927483861c0 x1874700152123648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853576 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853560.658790:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927483861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152123648:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787853560.709809:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853561.734116:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853562.694063:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152123776:0@lo:400:kworker.0 00000100:00100000:0.0:1787853562.694130:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853562.694269:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152123776 00000100:00100000:1.0:1787853562.694276:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152123776 00000100:00100000:1.0:1787853562.694320:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787853562.694334:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3298:x1874700152123776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853562.694442:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152123904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853562.694475:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853562.694774:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152124160:0@lo:400:kworker.0 00000100:00100000:2.0:1787853562.694853:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853562.694894:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787853562.694901:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152124032:0@lo:400:kworker.0 00000100:00100000:2.0:1787853562.694924:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853562.702234:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3298:x1874700152123776:12345-0@lo:400:kworker.0 Request processed in 7897us (8093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853562.702249:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787853562.702300:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152124160 00000100:00100000:2.0:1787853562.702348:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787853562.702364:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152124416:0@lo:400:kworker.0 00000100:00100000:2.0:1787853562.702431:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853562.702521:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853562.702532:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152124288:0@lo:400:kworker.0 00000100:00100000:3.0:1787853562.702564:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853562.702811:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152124160 00000100:00100000:2.0:1787853562.702815:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152124288 00000100:00100000:2.0:1787853562.702818:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152124288 00000100:00100000:1.0:1787853562.702907:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152124032 00000100:00100000:1.0:1787853562.702910:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152124032 00000100:00100000:1.0:1787853562.702922:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152124416 00000100:00100000:1.0:1787853562.702924:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152124416 00000100:00100000:0.0:1787853562.702928:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152123776:0@lo:400:kworker.0 00000100:00100000:0.0:1787853562.702970:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152123904 00000100:00100000:0.0:1787853562.702974:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152123904 00000100:00100000:2.0:1787853562.703025:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787853562.703036:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152124288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853562.703088:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152124288:12345-0@lo:400:kworker.0 Request processed in 54us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853562.703095:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1787853562.703873:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787853562.703879:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787853562.703882:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787853562.703914:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99274368b0c0 x1874700152124288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853562.703927:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152124288:0@lo:400:kworker.0 00000100:00100000:1.0:1787853562.704113:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787853562.704122:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743689680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152124160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853562.704263:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743689680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152124160:12345-0@lo:400:kworker.0 Request processed in 143us (9410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853562.704380:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787853562.704399:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787853562.704406:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743689e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152124032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853562.704450:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743689e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152124032:12345-0@lo:400:kworker.0 Request processed in 45us (9524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853562.704456:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787853562.704468:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787853562.704474:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152124416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853562.704523:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152124416:12345-0@lo:400:kworker.0 Request processed in 49us (2092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853562.704530:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787853562.704624:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787853562.704636:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152123904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787853562.704662:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853562.704716:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152123904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (10240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853562.704722:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787853562.704868:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152124032:0@lo:400:kworker.0 00010000:00080000:3.0:1787853562.704881:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277bc3da40 x1874700152123904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853578 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853562.704896:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152123904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853562.705058:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152124160:0@lo:400:kworker.0 00000100:00100000:2.0:1787853562.705084:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152124416:0@lo:400:kworker.0 00010000:00010000:0.0:1787853562.757825:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853563.787802:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853564.809246:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853565.378037:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853565.378090:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853565.378145:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853565.378174:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853565.378196:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853565.378224:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136363264 00000100:00100000:1.0:1787853565.378232:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136363264 00000100:00100000:1.0:1787853565.378282:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136363136 00000100:00100000:1.0:1787853565.378292:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136363136 00000100:00100000:1.0:1787853565.378314:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:1.0:1787853565.378324:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2363:x1874700136363264:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853565.378389:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2363:x1874700136363264:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 66us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853565.378413:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:1.0:1787853565.378431:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:1.0:1787853565.378438:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd35680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2363:x1874700136363136:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853565.378462:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd35680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2363:x1874700136363136:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 25us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853565.378480:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:1.0:1787853565.378499:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136363008 00000100:00100000:1.0:1787853565.378502:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136363008 00000100:00100000:1.0:1787853565.378525:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136362880 00000100:00100000:1.0:1787853565.378528:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136362880 00000100:00100000:1.0:1787853565.378546:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 75 00000100:00100000:1.0:1787853565.378552:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c2003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2363:x1874700136363008:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853565.378580:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c2003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2363:x1874700136363008:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 28us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853565.378586:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 75 00000100:00100000:1.0:1787853565.378598:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:1.0:1787853565.378605:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2363:x1874700136362880:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853565.378628:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2363:x1874700136362880:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 24us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853565.378635:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00080000:1.0:1787853565.378660:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853565.378664:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787853565.378666:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853565.378926:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136362752 00000100:00100000:0.0:1787853565.378931:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136362752 00000100:00100000:0.0:1787853565.378973:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 223 00000100:00100000:0.0:1787853565.378982:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2363:x1874700136362752:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853565.379021:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2363:x1874700136362752:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 41us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853565.379027:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 223 00000100:00100000:2.0:1787853565.774952:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dd36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152124544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853565.775023:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853565.775181:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152124544 00000100:00100000:1.0:1787853565.775189:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152124544 00000100:00100000:1.0:1787853565.775252:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787853565.775262:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152124544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787853565.775292:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853565.775336:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152124544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853565.775343:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1787853565.775557:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787853565.775585:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99276dd36d00 x1874700152124544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853565.775604:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dd36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152124544:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787853565.829863:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853566.854021:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853567.813983:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152124672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853567.814769:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748386d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152124800:0@lo:400:kworker.0 00000100:00100000:2.0:1787853567.814948:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853567.815032:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748386940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152125184:0@lo:400:kworker.0 00000100:00100000:0.0:1787853567.816770:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853567.816833:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748385a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1874700152125312:0@lo:400:kworker.0 00000100:00100000:0.0:1787853567.816869:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853567.816922:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748385e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152124928:0@lo:400:kworker.0 00000100:00100000:0.0:1787853567.816948:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853567.816978:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927483843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152125440:0@lo:400:kworker.0 00000100:00100000:0.0:1787853567.817005:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853567.817026:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787853567.817033:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748384780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152125056:0@lo:400:kworker.0 00000100:00100000:1.0:1787853567.817245:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152124800 00000100:00100000:1.0:1787853567.817256:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152124800 00000100:00100000:1.0:1787853567.817313:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787853567.817323:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3298:x1874700152124800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853567.818079:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853567.818161:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3298:x1874700152124800:12345-0@lo:400:kworker.0 Request processed in 839us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853567.818184:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787853567.821019:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853567.821135:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152124672 00000100:00100000:2.0:1787853567.821146:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152124672 00000100:00100000:2.0:1787853567.821228:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787853567.821240:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152124672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853567.821285:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853567.821361:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152124672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (6415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853567.821369:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1787853567.821394:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787853567.821433:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99276f6f43c0 x1874700152124672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853583 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853567.821473:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152124672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853567.821539:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152125312 00000100:00100000:2.0:1787853567.821559:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152125312 00000100:00100000:2.0:1787853567.821597:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152124928 00000100:00100000:2.0:1787853567.821601:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152124928 00000100:00100000:2.0:1787853567.821614:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152125056 00000100:00100000:2.0:1787853567.821617:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152125056 00000100:00100000:2.0:1787853567.821650:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787853567.821656:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874700152125312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853567.821790:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874700152125312:12345-0@lo:400:kworker.0 Request processed in 134us (4919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853567.821797:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787853567.821811:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787853567.821818:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748387c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152124928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853567.821851:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748387c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152124928:12345-0@lo:400:kworker.0 Request processed in 34us (4902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853567.821857:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787853567.821870:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787853567.821876:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152125056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853567.821906:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152125056:12345-0@lo:400:kworker.0 Request processed in 30us (3829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853567.821911:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1787853567.821940:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853567.821970:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152125440 00000100:00100000:2.0:1787853567.821974:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152125440 00000100:00100000:2.0:1787853567.821997:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152125184 00000100:00100000:2.0:1787853567.822000:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152125184 00000100:00100000:2.0:1787853567.822021:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787853567.822028:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277512f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152125440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853567.822061:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277512f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152125440:12345-0@lo:400:kworker.0 Request processed in 34us (5055us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853567.822075:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787853567.822260:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787853567.822268:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152125184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853567.822310:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152125184:12345-0@lo:400:kworker.0 Request processed in 45us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853567.822316:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1787853567.822332:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787853567.822353:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992748386940 x1874700152125184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853567.822365:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748386940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152125184:0@lo:400:kworker.0 00000100:00100000:1.0:1787853567.822758:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748386d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152124800:0@lo:400:kworker.0 00000100:00100000:1.0:1787853567.822777:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748385a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1874700152125312:0@lo:400:kworker.0 00000100:00100000:0.0:1787853567.825096:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748384780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152125056:0@lo:400:kworker.0 00000100:00100000:0.0:1787853567.825116:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748385e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152124928:0@lo:400:kworker.0 00010000:00080000:0.0:1787853567.825131:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9927483843c0 x1874700152125440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853567.825142:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927483843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152125440:0@lo:400:kworker.0 00010000:00010000:0.0:1787853567.879960:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853568.902819:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853569.925944:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853570.490011:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853570.490052:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853570.490076:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853570.490091:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853570.490108:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853570.490134:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136363392 00000100:00100000:1.0:1787853570.490144:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136363392 00000100:00100000:1.0:1787853570.490200:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 225 00000100:00100000:1.0:1787853570.490207:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2362:x1874700136363392:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853570.490263:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136363776 00000100:00100000:2.0:1787853570.490270:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136363776 00000100:00100000:1.0:1787853570.490276:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2362:x1874700136363392:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 69us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853570.490285:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 225 00000100:00100000:2.0:1787853570.490319:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136363904 00000100:00100000:2.0:1787853570.490323:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136363904 00000100:00100000:1.0:1787853570.490331:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:1.0:1787853570.490342:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2361:x1874700136363776:12345-192.168.206.10@tcp:9:kworker.0 00000100:00100000:2.0:1787853570.490360:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136363648 00000020:00000080:1.0:1787853570.490365:0:6671:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb05492f 00000100:00100000:2.0:1787853570.490366:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136363648 00000100:00080000:1.0:1787853570.490379:0:6671:0:(import.c:65:import_set_state_nolock()) ffff99276f6b1000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787853570.490406:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136363520 00000100:00100000:2.0:1787853570.490410:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136363520 00000001:00000004:1.0:1787853570.490431:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787853570.490451:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 80 00000100:00100000:2.0:1787853570.490461:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd34f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2362:x1874700136363648:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853570.490500:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd34f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2362:x1874700136363648:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 41us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853570.490509:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 80 00000100:00100000:2.0:1787853570.490530:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:2.0:1787853570.490538:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2362:x1874700136363520:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853570.490566:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2362:x1874700136363520:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 29us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853570.490581:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00080000:2.0:1787853570.490606:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787853570.490612:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787853570.490614:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853570.490881:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+2:2361:x1874700136363776:12345-192.168.206.10@tcp:9:kworker.0 Request processed in 542us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853570.490889:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:1.0:1787853570.490906:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:1.0:1787853570.490912:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2361:x1874700136363904:12345-192.168.206.10@tcp:9:kworker.0 00000020:00000080:1.0:1787853570.490925:0:6671:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb054936 00000100:00080000:1.0:1787853570.490932:0:6671:0:(import.c:65:import_set_state_nolock()) ffff99276f6b6800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787853570.490963:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1787853570.491047:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853570.491160:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+2:2361:x1874700136363904:12345-192.168.206.10@tcp:9:kworker.0 Request processed in 246us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853570.491167:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00010000:00010000:1.0:1787853570.491333:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853570.886094:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152125568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853570.886189:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853570.886378:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152125568 00000100:00100000:2.0:1787853570.886388:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152125568 00000100:00100000:2.0:1787853570.886481:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787853570.886492:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152125568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853570.886537:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853570.886589:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152125568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853570.886597:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787853570.886622:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787853570.886737:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99276f6f4000 x1874700152125568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853570.886760:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152125568:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787853570.963102:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787853570.979055:0:10997:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787853571.974205:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853572.933900:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787853572.933923:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152125696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853572.934005:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853572.934278:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dd36580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152125952:0@lo:400:kworker.0 00000100:00100000:0.0:1787853572.934311:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853572.934341:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787853572.934347:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dd361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152126080:0@lo:400:kworker.0 00000100:00100000:0.0:1787853572.934368:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853572.934401:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152125952 00000100:00100000:0.0:1787853572.934415:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152125952 00000100:00100000:0.0:1787853572.934476:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152126080 00000100:00100000:0.0:1787853572.934480:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152126080 00000100:00100000:0.0:1787853572.934508:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787853572.934516:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152125952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853572.934560:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152125952:12345-0@lo:400:kworker.0 Request processed in 45us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853572.934567:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787853572.934582:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787853572.934589:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152126080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853572.934617:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152126080:12345-0@lo:400:kworker.0 Request processed in 29us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853572.934622:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1787853572.934641:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853572.934654:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dd34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152126208:0@lo:400:kworker.0 00000100:00100000:0.0:1787853572.934702:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853572.934722:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787853572.934728:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dd34b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152125824:0@lo:400:kworker.0 00000100:00100000:0.0:1787853572.934754:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853572.934775:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dd36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1874700152126336:0@lo:400:kworker.0 00000100:00100000:0.0:1787853572.934795:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853572.934818:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152126208 00000100:00100000:0.0:1787853572.934821:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152126208 00000100:00100000:0.0:1787853572.934852:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787853572.934859:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152126208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853572.934889:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152126208:12345-0@lo:400:kworker.0 Request processed in 32us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853572.934905:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787853572.934922:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152125824 00000100:00100000:0.0:1787853572.934925:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152125824 00000100:00100000:0.0:1787853572.934949:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787853572.934956:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152125824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853572.934986:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152125824:12345-0@lo:400:kworker.0 Request processed in 31us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853572.934993:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:0.0:1787853572.935021:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853572.935046:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dd361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152126080:0@lo:400:kworker.0 00000100:00100000:0.0:1787853572.935057:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dd36580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152125952:0@lo:400:kworker.0 00000100:00100000:0.0:1787853572.935085:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dd34b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152125824:0@lo:400:kworker.0 00010000:00080000:0.0:1787853572.935096:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99276dd34000 x1874700152126208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853572.935107:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dd34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152126208:0@lo:400:kworker.0 00000100:00100000:0.0:1787853572.935128:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152126336 00000100:00100000:0.0:1787853572.935131:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152126336 00000100:00100000:0.0:1787853572.935159:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787853572.935166:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748385a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874700152126336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853572.935198:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748385a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874700152126336:12345-0@lo:400:kworker.0 Request processed in 33us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853572.935204:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1787853572.935218:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853572.935234:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dd36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1874700152126336:0@lo:400:kworker.0 00000100:00100000:2.0:1787853572.935385:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152125696 00000100:00100000:2.0:1787853572.935390:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152125696 00000100:00100000:2.0:1787853572.935420:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787853572.935437:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152125696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853572.935473:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853572.935511:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152125696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853572.935517:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787853572.935880:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787853572.935904:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99276f6f6580 x1874700152125696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853588 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853572.935921:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152125696:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787853572.997894:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853574.025156:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787853574.442993:0:11144:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdfb30bdf0 20000000:00000080:3.0:1787853574.443008:0:11144:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99277c1f0c00 uarg=0000000000000000 20000000:01000000:3.0:1787853574.443039:0:11144:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787853574.443044:0:11144:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787853574.443048:0:11144:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787853574.445570:0:11145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1787853574.445841:0:11144:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787853574.453486:0:11144:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787853574.453516:0:11144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99275064d200/0xcf1365f7cb05493d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.453535:0:11144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0548e2 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.453557:0:11144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9927429f6200/0xcf1365f7cb0548f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0548f0 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.453565:0:11144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9927429f7600/0xcf1365f7cb054905 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0548fe expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.453575:0:11144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9927429f7000/0xcf1365f7cb05490c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1eb8 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.453583:0:11144:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff992740030400/0xcf1365f7cb054921 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ef0 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.453590:0:11144:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99275064d200/0xcf1365f7cb05493d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.453630:0:11144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff992740030400/0xcf1365f7cb054921 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ef0 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.453646:0:11144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff992740030400/0xcf1365f7cb054921 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ef0 expref: 12 pid: 5816 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853574.453660:0:11144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11144:1874700152126464:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787853574.453800:0:11144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9927429f7000/0xcf1365f7cb05490c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1eb8 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.453809:0:11144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9927429f7000/0xcf1365f7cb05490c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1eb8 expref: 12 pid: 5818 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853574.453818:0:11144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11144:1874700152126592:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787853574.453862:0:11144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9927429f7600/0xcf1365f7cb054905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb0548fe expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.453871:0:11144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9927429f7600/0xcf1365f7cb054905 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb0548fe expref: 18 pid: 5819 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853574.453881:0:11144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11144:1874700152126720:0@lo:104: 00000100:00100000:3.0:1787853574.453919:0:11144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787853574.453951:0:11144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9927429f6200/0xcf1365f7cb0548f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb0548f0 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.453959:0:11144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9927429f6200/0xcf1365f7cb0548f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb0548f0 expref: 18 pid: 5816 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853574.453967:0:11144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11144:1874700152126848:0@lo:104: 00000100:00100000:3.0:1787853574.453986:0:11144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853574.454017:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152126720 00000100:00100000:3.0:1787853574.454023:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152126720 00000100:00100000:3.0:1787853574.454060:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152126848 00000100:00100000:3.0:1787853574.454064:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152126848 00000100:00100000:3.0:1787853574.454081:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787853574.454088:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+4:11144:x1874700152126720:12345-0@lo:104: 00010000:00010000:3.0:1787853574.454100:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9927429f6800/0xcf1365f7cb0548fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054905 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.454146:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787853574.454152:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+4:11144:x1874700152126720:12345-0@lo:104: Request processed in 65us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853574.454159:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787853574.454185:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787853574.454191:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:11144:x1874700152126848:12345-0@lo:104: 00010000:00010000:3.0:1787853574.454199:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb0548f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0548f7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.454230:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787853574.454235:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:11144:x1874700152126848:12345-0@lo:104: Request processed in 45us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853574.454241:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1787853574.454271:0:11144:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb0548e2 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.454280:0:11144:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb0548e2 expref: 18 pid: 5819 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853574.454288:0:11144:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11144:1874700152126976:0@lo:104: 00000100:00100000:3.0:1787853574.454311:0:11144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853574.454611:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152126976 00000100:00100000:2.0:1787853574.454616:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152126976 00000100:00100000:2.0:1787853574.454638:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787853574.454645:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:11144:x1874700152126976:12345-0@lo:104: 00010000:00010000:2.0:1787853574.454661:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb0548e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0548e9 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853574.454755:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787853574.454762:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9927429f6800/0xcf1365f7cb0548fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054905 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853574.454769:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927429f6800 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:0.0:1787853574.454774:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9927429f6800/0xcf1365f7cb0548fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb054905 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853574.454781:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9927429f6800/0xcf1365f7cb0548fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb054905 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853574.454789:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9927429f6800/0xcf1365f7cb0548fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb054905 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853574.454795:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787853574.454823:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9927429f6800/0xcf1365f7cb0548fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054905 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853574.454829:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853574.454846:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9927429f6800/0xcf1365f7cb0548fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054905 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853574.454852:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9927429f6800/0xcf1365f7cb0548fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054905 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853574.454875:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853574.454878:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb0548f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0548f7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853574.454884:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70800 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:0.0:1787853574.454886:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb0548f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb0548f7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853574.454893:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb0548f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb0548f7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853574.454899:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb0548f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb0548f7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853574.454904:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787853574.454918:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb0548f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0548f7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853574.454923:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853574.454929:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb0548f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0548f7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853574.454935:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb0548f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0548f7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853574.454943:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853574.454945:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853574.454947:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853574.454958:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748386d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152127104:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787853574.455076:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787853574.455082:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:11144:x1874700152126976:12345-0@lo:104: Request processed in 438us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853574.455088:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787853574.455111:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853574.455114:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb0548e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0548e9 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853574.455120:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031000 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1787853574.455123:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb0548e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb0548e9 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853574.455129:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb0548e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb0548e9 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853574.455135:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb0548e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb0548e9 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853574.455140:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787853574.455158:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb0548e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0548e9 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853574.455164:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853574.455178:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb0548e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0548e9 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853574.455184:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff992740031000/0xcf1365f7cb0548e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0548e9 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853574.455203:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853574.455205:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853574.455206:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853574.455231:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787853574.455242:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152127360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853574.455274:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853574.455312:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748386940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152127232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853574.455335:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853574.455375:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853574.455377:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152127360 00000100:00100000:2.0:1787853574.455382:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152127360 00000100:00100000:0.0:1787853574.455404:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152127232 00000100:00100000:0.0:1787853574.455408:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152127232 00010000:00010000:2.0:1787853574.455411:0:8433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548e9 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0548e2 expref: 19 pid: 5819 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853574.455439:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152127104 00010000:00010000:0.0:1787853574.455439:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9927429f6200/0xcf1365f7cb0548f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0548f0 expref: 20 pid: 5816 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853574.455442:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152127104 00010000:00010000:2.0:1787853574.455452:0:8433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9927429f7600/0xcf1365f7cb054905 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0548fe expref: 21 pid: 5819 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853574.455454:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787853574.455460:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274415e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+21:3298:x1874700152127360:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853574.455463:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787853574.455467:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c912fdd2-2ba1-4aef-9721-e9a024331fd8+21:3300:x1874700152127232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853574.455470:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853574.455472:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853574.455475:0:8433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9927429f6200/0xcf1365f7cb0548f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0548f0 expref: 21 pid: 5816 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853574.455475:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548e9 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0548e2 expref: 21 pid: 5819 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853574.455484:0:8433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9927429f6200/0xcf1365f7cb0548f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb0548f0 expref: 21 pid: 5816 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853574.455655:0:11144:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747b45300 going to sleep for 11 seconds 00000100:00100000:3.0:1787853574.455694:0:11144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11144:1874700152126720:0@lo:104: 00000100:00100000:3.0:1787853574.455704:0:11144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11144:1874700152126848:0@lo:104: 00000100:00100000:3.0:1787853574.455710:0:11144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11144:1874700152126976:0@lo:104: 00010000:00010000:0.0:1787853574.455768:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb0548e2 expref: 21 pid: 5819 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853574.455783:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927429f6600/0xcf1365f7cb0548e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb0548e2 expref: 21 pid: 5819 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853574.455795:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853574.455872:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274415e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+20:3298:x1874700152127360:12345-0@lo:103:ldlm_bl.0 Request processed in 412us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853574.455879:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787853574.455918:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787853574.455927:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748386580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152127104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853574.455934:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853574.455939:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9927429f7600/0xcf1365f7cb054905 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0548fe expref: 19 pid: 5819 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853574.455946:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9927429f7600/0xcf1365f7cb054905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb0548fe expref: 19 pid: 5819 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853574.455964:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927429f7600/0xcf1365f7cb054905 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb0548fe expref: 19 pid: 5819 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853574.455973:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853574.456002:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748386580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:3299:x1874700152127104:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853574.456007:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787853574.456033:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748386d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152127104:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853574.456062:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853574.456120:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152127360:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787853574.457508:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927429f6200/0xcf1365f7cb0548f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb0548f0 expref: 17 pid: 5816 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853574.457535:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853574.457637:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:3300:x1874700152127232:12345-0@lo:103:ldlm_bl.0 Request processed in 2167us (2299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853574.457651:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787853574.457915:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748386940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152127232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787853574.458365:0:11144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11144:1874700152126464:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787853574.458376:0:11144:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11144:1874700152126592:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787853574.458410:0:11144:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99275064d200/0xcf1365f7cb05493d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853574.463337:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853574.463714:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136364032 00000100:00100000:0.0:1787853574.463724:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136364032 00010000:00010000:0.0:1787853574.463775:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff992740030400/0xcf1365f7cb054921 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ef0 expref: 13 pid: 5816 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853574.463812:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:1.0:1787853574.463815:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853574.463826:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd34780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2364:x1874700136364032:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853574.463841:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853574.463846:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff992740030400/0xcf1365f7cb054921 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ef0 expref: 13 pid: 5816 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853574.463865:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff992740030400/0xcf1365f7cb054921 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ef0 expref: 13 pid: 5816 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853574.463882:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992740030400/0xcf1365f7cb054921 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ef0 expref: 13 pid: 5816 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853574.463898:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853574.463976:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd34780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7076e8b-41d6-499a-b764-6185164c5ac6+12:2364:x1874700136364032:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 154us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853574.463984:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:0.0:1787853574.464001:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136364160 00000100:00100000:0.0:1787853574.464004:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136364160 00010000:00010000:0.0:1787853574.464020:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9927429f7000/0xcf1365f7cb05490c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1eb8 expref: 12 pid: 5818 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853574.464170:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:3.0:1787853574.464181:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd370c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7076e8b-41d6-499a-b764-6185164c5ac6+12:2365:x1874700136364160:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853574.464191:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853574.464197:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9927429f7000/0xcf1365f7cb05490c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1eb8 expref: 12 pid: 5818 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.464281:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9927429f7000/0xcf1365f7cb05490c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1eb8 expref: 12 pid: 5818 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.464295:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927429f7000/0xcf1365f7cb05490c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1eb8 expref: 12 pid: 5818 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.464307:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99275064d200/0xcf1365f7cb05493d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.464315:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99275064d200/0xcf1365f7cb05493d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.464328:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99275064d200/0xcf1365f7cb05493d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.464336:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99275064d200/0xcf1365f7cb05493d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.464343:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99275064d200/0xcf1365f7cb05493d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.464350:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99275064d200/0xcf1365f7cb05493d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.464368:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d200 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:3.0:1787853574.464372:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99275064d200/0xcf1365f7cb05493d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.464380:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99275064d200/0xcf1365f7cb05493d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853574.465646:0:11144:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99275064d200/0xcf1365f7cb05493d lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853574.465660:0:11144:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99275064d200/0xcf1365f7cb05493d lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.468005:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99275064d200/0xcf1365f7cb05493d lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.468025:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99275064d200/0xcf1365f7cb05493d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853574.468553:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853574.468699:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd370c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7076e8b-41d6-499a-b764-6185164c5ac6+11:2365:x1874700136364160:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 4515us (4884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853574.468710:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 29 00000001:00100000:1.0:1787853574.518625:0:7622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bcff1eac-63bd-47ee-ba0c-e172aa18acea 00000020:00000080:1.0:1787853574.518634:0:7622:0:(genops.c:885:class_export_put()) final put ffff99276f6b6000/bcff1eac-63bd-47ee-ba0c-e172aa18acea 00000020:00000080:1.0:1787853574.518661:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99276f6b6000/bcff1eac-63bd-47ee-ba0c-e172aa18acea for lustre-OST0001 00000020:00000080:1.0:1787853574.518729:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99276f6b6800 for lustre-OST0001 00000001:00100000:2.0:1787853574.546546:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bcff1eac-63bd-47ee-ba0c-e172aa18acea 00000020:00000080:2.0:1787853574.546555:0:6697:0:(genops.c:885:class_export_put()) final put ffff99276f6b4800/bcff1eac-63bd-47ee-ba0c-e172aa18acea 00000020:00000080:2.0:1787853574.546581:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99276f6b4800/bcff1eac-63bd-47ee-ba0c-e172aa18acea for lustre-OST0000 00000020:00000080:2.0:1787853574.546620:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99276f6b1000 for lustre-OST0000 00010000:00010000:2.0:1787853575.053234:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853575.617750:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853575.617791:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853575.617819:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853575.617834:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136364288 00000100:00100000:2.0:1787853575.617843:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136364288 00000100:00100000:1.0:1787853575.617850:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136364416 00000100:00100000:1.0:1787853575.617853:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136364416 00000100:00100000:1.0:1787853575.617885:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136364544 00000100:00100000:1.0:1787853575.617888:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136364544 00000100:00100000:2.0:1787853575.617891:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 227 00000100:00100000:2.0:1787853575.617899:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+11:2362:x1874700136364288:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853575.617906:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00100000:1.0:1787853575.617912:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2362:x1874700136364416:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853575.618096:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+11:2362:x1874700136364288:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 197us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853575.618105:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 227 00000100:00100000:0.0:1787853575.619859:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:0.0:1787853575.619879:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2362:x1874700136364544:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853575.625477:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2362:x1874700136364416:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 7554us (7728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853575.625491:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00080000:1.0:1787853575.625542:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853575.637828:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2362:x1874700136364544:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 17945us (19995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853575.637844:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:1.0:1787853575.929776:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853575.929884:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136364672 00000100:00100000:0.0:1787853575.929893:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136364672 00000100:00100000:0.0:1787853575.929951:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 228 00000100:00100000:0.0:1787853575.929962:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+11:5602:x1874700136364672:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853575.929977:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853575.929995:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992740030a00/0xcf1365f7cb054944 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1f1a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853575.930021:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992740030a00/0xcf1365f7cb054944 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f1a expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853575.930032:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992740030a00/0xcf1365f7cb054944 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f1a expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853575.930041:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992740030a00, rc 0) 00000100:00100000:0.0:1787853575.930110:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+12:5602:x1874700136364672:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 149us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853575.930118:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 228 00000100:00100000:1.0:1787853575.935103:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853575.935172:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136364800 00000100:00100000:0.0:1787853575.935180:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136364800 00000100:00100000:0.0:1787853575.935234:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 229 00000100:00100000:0.0:1787853575.935244:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+12:5602:x1874700136364800:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853575.935524:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+12:5602:x1874700136364800:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 281us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853575.935533:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 229 00000100:00100000:3.0:1787853575.942180:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853575.942254:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136364928 00000100:00100000:2.0:1787853575.942262:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136364928 00000100:00100000:2.0:1787853575.942316:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 230 00000100:00100000:2.0:1787853575.942326:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+12:5602:x1874700136364928:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853575.942533:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+12:5602:x1874700136364928:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 Request processed in 207us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853575.942542:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 230 00000100:00100000:0.0:1787853575.961312:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853575.965785:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136365056 00000100:00100000:1.0:1787853575.965799:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136365056 00000100:00100000:1.0:1787853575.965861:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 231 00000100:00100000:1.0:1787853575.965871:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+12:5602:x1874700136365056:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853575.965886:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853575.965904:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992766197e00/0xcf1365f7cb05494b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1f21 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853575.965931:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992766197e00/0xcf1365f7cb05494b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f21 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853575.965942:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992766197e00/0xcf1365f7cb05494b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f21 expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853575.965951:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766197e00, rc 0) 00000100:00100000:1.0:1787853575.966155:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:5602:x1874700136365056:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 284us (4851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853575.966162:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 231 00000100:00100000:2.0:1787853575.975569:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853575.976544:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136365184 00000100:00100000:0.0:1787853575.976556:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136365184 00000100:00100000:0.0:1787853575.976620:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 232 00000100:00100000:0.0:1787853575.976631:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:5602:x1874700136365184:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853575.976914:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:5602:x1874700136365184:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 285us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853575.976922:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 232 00000100:00100000:0.0:1787853575.986846:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853575.989613:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136365312 00000100:00100000:2.0:1787853575.989638:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136365312 00000100:00100000:2.0:1787853575.989709:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 233 00000100:00100000:2.0:1787853575.989719:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:5602:x1874700136365312:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853575.990581:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:5602:x1874700136365312:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 Request processed in 858us (3740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853575.990595:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 233 00000100:00100000:1.0:1787853576.005922:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152127488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853576.005991:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853576.006077:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152127488 00000100:00100000:2.0:1787853576.006084:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152127488 00000100:00100000:2.0:1787853576.006139:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787853576.006148:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd36d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152127488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853576.006179:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787853576.012783:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853576.015168:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd36d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152127488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9014us (9170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853576.015183:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1787853576.025598:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99276f6f5680 x1874700152127488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853576.025628:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152127488:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787853576.069800:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787853576.391279:0:5821:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787853576.391287:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9927441ba000 from 7 10000000:01000000:2.0:1787853576.391292:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787853576.391339:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f70000/0xcf1365f7cb054952 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853576.391351:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992747f70000/0xcf1365f7cb054952 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853576.391362:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992747f70000/0xcf1365f7cb054952 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853576.391386:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152127616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787853576.391473:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853576.391537:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747b456c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853576.391738:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152127616 00000100:00100000:0.0:1787853576.391745:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152127616 00000100:00100000:0.0:1787853576.391934:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787853576.391944:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:5821:x1874700152127616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853576.391958:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853576.391970:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992740030400/0xcf1365f7cb054959 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb054952 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853576.391993:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992740030400/0xcf1365f7cb054959 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb054952 expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853576.392004:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992740030400/0xcf1365f7cb054959 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054952 expref: 17 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853576.392013:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992740030400, rc 0) 00000100:00100000:0.0:1787853576.392055:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152127616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853576.392063:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787853576.392167:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152127616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853576.392181:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992747f70000/0xcf1365f7cb054952 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054959 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853576.392190:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992747f70000/0xcf1365f7cb054952 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054959 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853576.392245:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152127744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853576.392275:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853576.392297:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747b456c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853576.392310:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152127744 00000100:00100000:2.0:1787853576.392314:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152127744 00000100:00100000:2.0:1787853576.392346:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787853576.392352:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152127744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853576.392585:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152127744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853576.392592:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787853576.392624:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152127744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853576.392651:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152127872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853576.392715:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853576.392734:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747b456c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853576.392745:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152127872 00000100:00100000:2.0:1787853576.392749:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152127872 00000100:00100000:2.0:1787853576.392767:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787853576.392773:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152127872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853576.392911:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152127872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853576.392917:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787853576.392952:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152127872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787853576.393858:0:11225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787853576.394041:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787853576.394062:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787853576.394071:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f70000/0xcf1365f7cb054952 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054959 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853576.394083:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992747f70000/0xcf1365f7cb054952 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054959 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853576.394094:0:5821:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787853576.394097:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9927660b0000 from 7 10000000:01000000:2.0:1787853576.394100:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787853576.394128:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb054960 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853576.394137:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb054960 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853576.394146:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb054960 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853576.394164:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152128000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787853576.394208:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853576.394244:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747a1bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853576.394379:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152128000 00000100:00100000:0.0:1787853576.394386:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152128000 00000100:00100000:0.0:1787853576.394439:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787853576.394449:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152128000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853576.394461:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853576.394473:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992740031a00/0xcf1365f7cb054967 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb054960 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853576.394493:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992740031a00/0xcf1365f7cb054967 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb054960 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853576.394503:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992740031a00/0xcf1365f7cb054967 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054960 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853576.394523:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992740031a00, rc 0) 00000100:00100000:0.0:1787853576.394569:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152128000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853576.394576:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787853576.394744:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152128000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853576.394763:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb054960 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054967 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853576.394772:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb054960 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054967 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853576.394817:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152128128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853576.394843:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853576.394864:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747a1bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853576.397651:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152128128 00000100:00100000:0.0:1787853576.397665:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152128128 00000100:00100000:0.0:1787853576.397794:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787853576.397806:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152128128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853576.398089:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152128128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (3244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853576.398098:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787853576.398157:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152128128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853576.398210:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748386d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152128256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787853576.398254:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853576.398271:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c218b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787853576.398356:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152128256 00000100:00100000:1.0:1787853576.398361:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152128256 00000100:00100000:1.0:1787853576.398394:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787853576.398402:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152128256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853576.398558:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152128256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853576.398572:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787853576.398841:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748386d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152128256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787853576.400768:0:11226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787853576.400916:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787853576.400939:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787853576.400951:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb054960 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054967 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853576.400963:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb054960 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054967 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853576.400974:0:5821:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787853576.400977:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9927436b6000 from 7 10000000:01000000:1.0:1787853576.400980:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787853576.401013:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992766196e00/0xcf1365f7cb05496e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853576.401023:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992766196e00/0xcf1365f7cb05496e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853576.401033:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992766196e00/0xcf1365f7cb05496e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853576.401055:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dd35a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152128384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787853576.401111:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853576.401153:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927463b3000 going to sleep for 11 seconds 00000100:00100000:0.0:1787853576.401209:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152128384 00000100:00100000:0.0:1787853576.401215:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152128384 00000100:00100000:0.0:1787853576.401299:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787853576.401309:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152128384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853576.401322:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853576.401334:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992740030600/0xcf1365f7cb054975 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb05496e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853576.401373:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992740030600/0xcf1365f7cb054975 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb05496e expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853576.401384:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992740030600/0xcf1365f7cb054975 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05496e expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853576.401394:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992740030600, rc 0) 00000100:00100000:0.0:1787853576.401454:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152128384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853576.401460:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787853576.402467:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dd35a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152128384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853576.402489:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992766196e00/0xcf1365f7cb05496e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054975 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853576.402501:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992766196e00/0xcf1365f7cb05496e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054975 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853576.402566:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152128512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853576.402608:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853576.406212:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152128512 00000100:00100000:1.0:1787853576.406226:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152128512 00000100:00100000:1.0:1787853576.406271:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787853576.406279:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152128512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853576.408164:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152128512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1879us (5549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853576.408182:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787853576.411034:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0840 going to sleep for 11 seconds 00000100:00100000:3.0:1787853576.411073:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152128512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853576.411129:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152128640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853576.422286:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853576.422346:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0840 going to sleep for 11 seconds 00000100:00100000:0.0:1787853576.422442:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152128640 00000100:00100000:0.0:1787853576.422450:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152128640 00000100:00100000:0.0:1787853576.422500:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787853576.422510:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152128640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787853576.422749:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152128640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 240us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853576.422758:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787853576.422932:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152128640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787853576.434306:0:11231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787853576.435922:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787853576.435950:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787853576.435960:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992766196e00/0xcf1365f7cb05496e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054975 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853576.435971:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992766196e00/0xcf1365f7cb05496e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054975 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853577.097138:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853578.055571:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787853578.056333:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874700152128896:0@lo:400:kworker.0 00000100:00100000:3.0:1787853578.056415:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853578.056514:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152128768:0@lo:400:kworker.0 00000100:00100000:3.0:1787853578.056542:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853578.056584:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152128768 00000100:00100000:3.0:1787853578.056591:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152128768 00000100:00100000:3.0:1787853578.056632:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787853578.056641:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3300:x1874700152128768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853578.056707:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3300:x1874700152128768:12345-0@lo:400:kworker.0 Request processed in 67us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853578.056715:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787853578.058641:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152128768:0@lo:400:kworker.0 00000100:00100000:3.0:1787853578.059271:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152129024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853578.059325:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853578.059379:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152129024 00000100:00100000:3.0:1787853578.059384:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152129024 00000100:00100000:3.0:1787853578.059448:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787853578.060265:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152129024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787853578.060302:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853578.060355:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152129024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 881us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853578.060362:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1787853578.060388:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787853578.060426:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992747b4f480 x1874700152129024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853578.060444:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152129024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853578.061923:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1874700152129152:0@lo:400:kworker.0 00000100:00100000:3.0:1787853578.061979:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853578.064308:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152129408:0@lo:400:kworker.0 00000100:00100000:2.0:1787853578.068655:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853578.075075:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152128896 00000100:00100000:1.0:1787853578.075090:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152128896 00000100:00100000:1.0:1787853578.075121:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152129280:0@lo:400:kworker.0 00000100:00100000:1.0:1787853578.075194:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853578.075332:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152129280 00000100:00100000:1.0:1787853578.075337:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152129280 00000100:00100000:1.0:1787853578.075417:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787853578.075427:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd36940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152129280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853578.075495:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd36940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152129280:12345-0@lo:400:kworker.0 Request processed in 70us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853578.075502:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1787853578.075538:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99276f6f6d00 x1874700152129280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853578.075553:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152129280:0@lo:400:kworker.0 00000100:00080000:1.0:1787853578.075574:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853578.075608:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152129152 00000100:00100000:1.0:1787853578.075612:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152129152 00000100:00100000:1.0:1787853578.075639:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787853578.075656:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874700152128896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853578.075724:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874700152128896:12345-0@lo:400:kworker.0 Request processed in 69us (19310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853578.079772:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787853578.080531:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787853578.080550:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874700152129152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853578.080644:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874700152129152:12345-0@lo:400:kworker.0 Request processed in 102us (18663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853578.080652:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787853578.081809:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1874700152129152:0@lo:400:kworker.0 00000100:00100000:3.0:1787853578.086622:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152129408 00000100:00100000:3.0:1787853578.086636:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152129408 00000100:00100000:3.0:1787853578.086718:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787853578.086728:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152129408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853578.086860:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874700152128896:0@lo:400:kworker.0 00000100:00100000:3.0:1787853578.097749:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152129408:12345-0@lo:400:kworker.0 Request processed in 11002us (29079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853578.097763:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787853578.097825:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152129408:0@lo:400:kworker.0 00000100:00080000:1.0:1787853578.098186:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787853578.118088:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787853578.416966:0:11345:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787853579.144944:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853580.171277:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853580.746647:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853580.746728:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853580.746759:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853580.746799:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136365696 00000100:00100000:0.0:1787853580.746810:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136365696 00000100:00100000:0.0:1787853580.746885:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136365568 00000100:00100000:0.0:1787853580.746889:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136365568 00000100:00100000:0.0:1787853580.746925:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 90 00000100:00100000:0.0:1787853580.746937:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748386d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2364:x1874700136365696:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853580.747049:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748386d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2364:x1874700136365696:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 114us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853580.747058:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 90 00000100:00100000:0.0:1787853580.747078:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 91 00000100:00100000:0.0:1787853580.747101:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748385680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2364:x1874700136365568:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853580.747127:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748385680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2364:x1874700136365568:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 42us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853580.747134:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 91 00000100:00080000:0.0:1787853580.747153:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853580.747489:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136365440 00000100:00100000:2.0:1787853580.747496:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136365440 00000100:00100000:2.0:1787853580.747532:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 244 00000100:00100000:2.0:1787853580.747539:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2364:x1874700136365440:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853580.747572:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2364:x1874700136365440:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 34us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853580.747579:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 244 00000100:00100000:3.0:1787853581.126096:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152129536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853581.126196:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853581.126245:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152129536 00000100:00100000:2.0:1787853581.126255:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152129536 00000100:00100000:2.0:1787853581.126347:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787853581.126360:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152129536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853581.126421:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853581.126485:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152129536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853581.126510:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1787853581.126580:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787853581.126593:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99276f6f70c0 x1874700152129536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853581.126618:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152129536:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787853581.191474:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787853582.055631:0:11444:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 13:59:40 (1787853580) === 00010000:00010000:1.0:1787853582.214622:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853582.234030:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853582.234079:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853582.234332:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136365952 00000100:00100000:3.0:1787853582.234344:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136365952 00000100:00100000:3.0:1787853582.234423:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:3.0:1787853582.234435:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd36580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:9684:x1874700136365952:12345-192.168.206.10@tcp:700:mkdir.0 00000100:00100000:3.0:1787853582.234538:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd36580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:9684:x1874700136365952:12345-192.168.206.10@tcp:700:mkdir.0 Request processed in 105us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853582.234547:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:0.0:1787853582.237926:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136365824 00000100:00100000:0.0:1787853582.237947:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136365824 00000100:00100000:0.0:1787853582.238051:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:0.0:1787853582.238064:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2364:x1874700136365824:12345-192.168.206.10@tcp:41:mkdir.0 00000004:00000024:0.0:1787853582.238123:0:7618:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787853582.238227:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2364:x1874700136365824:12345-192.168.206.10@tcp:41:mkdir.0 Request processed in 166us (4209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853582.238236:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00080000:0.0:1787853582.238262:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853582.247447:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853582.248201:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136366208 00000100:00100000:2.0:1787853582.248214:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136366208 00000100:00100000:2.0:1787853582.248286:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:2.0:1787853582.248297:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:9684:x1874700136366208:12345-192.168.206.10@tcp:36:mkdir.0 00010000:00010000:2.0:1787853582.248388:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853582.248568:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb05485d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ea3 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.248598:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992761dc9900) 00010000:00010000:2.0:1787853582.248610:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853582.249204:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb05497c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.249219:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb05497c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.249229:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb05497c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.251336:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054983 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.251356:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054983 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.251368:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054983 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853582.258888:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787853582.258905:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb05497c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.258915:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb05497c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.258923:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb05497c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.258929:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853582.258933:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb05497c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.258941:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb05497c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.258959:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992743be3600) 00010000:00010000:2.0:1787853582.258962:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853582.258967:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb05497c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.258973:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb05497c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787853582.258993:0:5825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084315632 reply state 00000000cf81bfb2 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054983 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853582.259002:0:5825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787853582.259116:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:9684:x1874700136366208:12345-192.168.206.10@tcp:36:mkdir.0 Request processed in 10817us (11682us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787853582.259135:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00010000:00010000:0.0:1787853582.264582:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054983 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.264604:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054983 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.264613:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054983 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.264635:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71a00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853582.264640:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054983 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.264649:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054983 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.264705:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff992743be3400) 00010000:00010000:0.0:1787853582.264709:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853582.264715:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054983 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.264722:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054983 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853582.272836:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853582.272906:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136366336 00000100:00100000:0.0:1787853582.272922:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136366336 00000100:00100000:0.0:1787853582.273001:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:0.0:1787853582.273015:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:9685:x1874700136366336:12345-192.168.206.10@tcp:101:chmod.0 00010000:00010000:0.0:1787853582.273043:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853582.273071:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb05498a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1f28 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.273154:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054991 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.273171:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054991 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.273184:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054991 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853582.273289:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787853582.273293:0:7618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853582.273355:0:7618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054991 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.273402:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb05498a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f28 expref: 8 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.273424:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054991 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f28 expref: 7 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.273434:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992761dc9100) 00010000:00010000:0.0:1787853582.273438:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787853582.273443:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992740031800, rc 0) 00000100:00100000:0.0:1787853582.273531:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:9685:x1874700136366336:12345-192.168.206.10@tcp:101:chmod.0 Request processed in 520us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853582.273539:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:3.0:1787853582.280244:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853582.280346:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136366592 00000100:00100000:2.0:1787853582.280358:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136366592 00000100:00100000:2.0:1787853582.280445:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:2.0:1787853582.280457:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:9685:x1874700136366592:12345-192.168.206.10@tcp:36:chmod.0 00010000:00010000:2.0:1787853582.280528:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853582.280563:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054991 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f28 expref: 7 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.280584:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992761dc9100) 00010000:00010000:2.0:1787853582.280599:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853582.280634:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054998 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.280649:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054998 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.280697:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054998 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787853582.281115:0:5825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000691e7e22 reply state 000000004deec46d transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054998 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853582.281127:0:5825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787853582.281148:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787853582.281618:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:9685:x1874700136366592:12345-192.168.206.10@tcp:36:chmod.0 Request processed in 1161us (1385us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787853582.281629:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 17 00010000:00010000:2.0:1787853582.284758:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054998 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.284777:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054998 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.284786:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054998 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.284793:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853582.284798:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054998 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.284807:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054998 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.284828:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992743be3600) 00010000:00010000:2.0:1787853582.284831:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787853582.284837:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054998 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.284844:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054998 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853582.310877:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853582.311180:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136366720 00000100:00100000:2.0:1787853582.311194:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136366720 00000100:00100000:2.0:1787853582.311288:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:2.0:1787853582.311299:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:9686:x1874700136366720:12345-192.168.206.10@tcp:101:chown.0 00010000:00010000:2.0:1787853582.311330:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853582.311358:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb05499f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1f2f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.311491:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71200/0xcf1365f7cb0549a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.311508:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71200/0xcf1365f7cb0549a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.311522:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71200/0xcf1365f7cb0549a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853582.311599:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787853582.311604:0:5826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853582.311658:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71200/0xcf1365f7cb0549a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.311741:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb05499f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f2f expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.311766:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71200/0xcf1365f7cb0549a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f2f expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.311774:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992743be3600) 00010000:00010000:2.0:1787853582.311777:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853582.311781:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71200, rc 0) 00000100:00100000:3.0:1787853582.311927:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:9686:x1874700136366720:12345-192.168.206.10@tcp:101:chown.0 Request processed in 627us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853582.311937:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:3.0:1787853582.315834:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853582.316049:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136366848 00000100:00100000:2.0:1787853582.316061:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136366848 00000100:00100000:2.0:1787853582.316163:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:2.0:1787853582.316174:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:9686:x1874700136366848:12345-192.168.206.10@tcp:101:chown.0 00010000:00010000:2.0:1787853582.316197:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853582.316237:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb0549ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1f36 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316319:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb0549b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316335:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb0549b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316347:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb0549b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316361:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb0549bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316368:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb0549bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316387:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb0549bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316503:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0549c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316512:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0549c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316520:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0549c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853582.316566:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787853582.316571:0:5825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853582.316597:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0549c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316619:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb0549b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316625:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb0549b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316632:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb0549b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316651:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853582.316657:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb0549b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316666:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb0549b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316911:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992743be3600) 00010000:00010000:2.0:1787853582.316915:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853582.316921:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb0549b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316928:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb0549b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316942:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb0549bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316949:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb0549bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316955:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb0549bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316967:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853582.316970:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb0549bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316976:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb0549bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316983:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff992743be3200) 00010000:00010000:2.0:1787853582.316985:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853582.316988:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb0549bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.316994:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb0549bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.317029:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb0549ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f36 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.317042:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0549c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f36 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.317049:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff992743be3400) 00010000:00010000:2.0:1787853582.317052:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853582.317054:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70e00, rc 0) 00000100:00100000:2.0:1787853582.317170:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:9686:x1874700136366848:12345-192.168.206.10@tcp:101:chown.0 Request processed in 997us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853582.317177:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:2.0:1787853582.321385:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853582.321936:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136367104 00000100:00100000:0.0:1787853582.321949:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136367104 00000100:00100000:0.0:1787853582.322046:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:0.0:1787853582.322058:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:9686:x1874700136367104:12345-192.168.206.10@tcp:36:chown.0 00010000:00010000:0.0:1787853582.322129:0:7618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853582.322165:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0549c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f36 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.322190:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff992743be3400) 00010000:00010000:0.0:1787853582.322206:0:7618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853582.322248:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb0549c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.322264:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb0549c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.322275:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb0549c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787853582.380255:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1787853582.380590:0:7618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003cf251f1 reply state 0000000026eb0283 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb0549c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853582.380604:0:7618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787853582.380876:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1787853582.380977:0:7618:0:(ldlm_lib.c:3492:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787853582.381036:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:9686:x1874700136367104:12345-192.168.206.10@tcp:36:chown.0 Request processed in 58977us (59673us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787853582.381045:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 20 00010000:00010000:0.0:1787853582.381542:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb0549c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.381552:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb0549c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.381560:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb0549c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.381566:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853582.381570:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb0549c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.381577:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb0549c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.381594:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff992761dc9800) 00010000:00010000:0.0:1787853582.381597:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787853582.381601:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb0549c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.381608:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb0549c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853582.410147:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853582.413633:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136367232 00000100:00100000:3.0:1787853582.413646:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136367232 00000100:00100000:3.0:1787853582.413800:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:3.0:1787853582.413812:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:9687:x1874700136367232:12345-192.168.206.10@tcp:101:touch.500 00010000:00010000:3.0:1787853582.413838:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853582.413875:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb0549d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1f3d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787853582.415774:0:5824:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1850us 00010000:00010000:2.0:1787853582.439199:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb0549d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.439228:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb0549d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.439241:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb0549d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.439258:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb0549de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.439265:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb0549de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.439272:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb0549de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.439754:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb0549e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.439764:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb0549e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.439772:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb0549e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853582.439851:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787853582.439856:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853582.439944:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb0549e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.439965:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb0549d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.439971:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb0549d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.439977:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb0549d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.439982:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853582.439985:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb0549d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.439992:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb0549d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.440002:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992743be3600) 00010000:00010000:2.0:1787853582.440004:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853582.440007:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb0549d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.440013:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb0549d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.440023:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb0549de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.440028:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb0549de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.440033:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb0549de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.440042:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853582.440045:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb0549de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.440050:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb0549de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.440057:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff992743be3900) 00010000:00010000:2.0:1787853582.440058:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853582.440060:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb0549de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.440066:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb0549de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.440099:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb0549d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f3d expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.440114:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb0549e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f3d expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.440121:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff992743be3200) 00010000:00010000:2.0:1787853582.440123:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787853582.440125:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71c00, rc 0) 00000100:00100000:2.0:1787853582.440190:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:9687:x1874700136367232:12345-192.168.206.10@tcp:101:touch.500 Request processed in 26380us (30051us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853582.440200:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:0.0:1787853582.447148:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853582.447244:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136367488 00000100:00100000:3.0:1787853582.447253:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136367488 00000100:00100000:3.0:1787853582.447308:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:3.0:1787853582.447318:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748387840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:9687:x1874700136367488:12345-192.168.206.10@tcp:101:touch.500 00010000:00010000:3.0:1787853582.447337:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853582.447357:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064de00/0xcf1365f7cb0549ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1f44 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.447712:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb0549f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.447728:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb0549f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.447741:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb0549f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.447800:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb0549fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.447808:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb0549fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.447814:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb0549fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787853582.448535:0:5826:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787853582.448825:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054a01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.448837:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054a01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.448845:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054a01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.448877:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb0549f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.448885:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb0549f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.448892:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb0549f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.448898:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064cc00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853582.448901:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb0549f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.448909:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb0549f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.448920:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff992743be3200) 00010000:00010000:3.0:1787853582.448923:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853582.448928:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb0549f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.448934:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb0549f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853582.448956:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081d5c834 reply state 0000000097adc244 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb0549fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853582.448964:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787853582.448995:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064de00/0xcf1365f7cb0549ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f44 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.449010:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054a01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f44 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.449018:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853582.449021:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853582.449023:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064d000, rc 0) 00000100:00100000:3.0:1787853582.449096:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748387840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+10:9687:x1874700136367488:12345-192.168.206.10@tcp:101:touch.500 Request processed in 1779us (1957us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787853582.449104:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:0.0:1787853582.454966:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853582.455202:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136367744 00000100:00100000:3.0:1787853582.455211:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136367744 00000100:00100000:3.0:1787853582.455262:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:3.0:1787853582.455271:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+10:9687:x1874700136367744:12345-192.168.206.10@tcp:36:touch.500 00010000:00010000:3.0:1787853582.455329:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853582.455354:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054a01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f44 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.455373:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853582.455394:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787853582.455447:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064ca00/0xcf1365f7cb054a0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.455461:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064ca00/0xcf1365f7cb054a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.455470:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064ca00/0xcf1365f7cb054a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853582.455590:0:5825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8fbe7d8 reply state 00000000e77c2671 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff99275064ca00/0xcf1365f7cb054a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853582.455598:0:5825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787853582.455706:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+11:9687:x1874700136367744:12345-192.168.206.10@tcp:36:touch.500 Request processed in 435us (749us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787853582.455714:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 23 00010000:00010000:2.0:1787853582.456551:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb0549fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.456574:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb0549fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.456581:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb0549fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.456588:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064c600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853582.456592:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb0549fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.456600:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb0549fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.456613:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc446f69f (ffff992742cdd500) 00010000:00010000:2.0:1787853582.456616:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853582.456620:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb0549fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.456626:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb0549fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.457128:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064ca00/0xcf1365f7cb054a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.457136:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064ca00/0xcf1365f7cb054a0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.457142:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064ca00/0xcf1365f7cb054a0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.457146:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064ca00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853582.457150:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064ca00/0xcf1365f7cb054a0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.457156:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064ca00/0xcf1365f7cb054a0f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.457165:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff992742cddf00) 00010000:00010000:0.0:1787853582.457168:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853582.457170:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064ca00/0xcf1365f7cb054a0f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.457176:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064ca00/0xcf1365f7cb054a0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853582.457420:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853582.457518:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136367872 00000100:00100000:0.0:1787853582.457525:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136367872 00000100:00100000:0.0:1787853582.457576:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 24 00000100:00100000:0.0:1787853582.457585:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:9687:x1874700136367872:12345-192.168.206.10@tcp:101:touch.500 00010000:00010000:0.0:1787853582.457605:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853582.457620:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054a16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1f4b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.457708:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054a16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f4b expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.457722:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054a16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f4b expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.457739:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff992761dc9800) 00010000:00010000:0.0:1787853582.457742:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787853582.457744:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992740031000, rc 0) 00000100:00100000:0.0:1787853582.458026:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+10:9687:x1874700136367872:12345-192.168.206.10@tcp:101:touch.500 Request processed in 441us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853582.458034:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 24 00000100:00100000:3.0:1787853582.469322:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853582.469460:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136368000 00000100:00100000:0.0:1787853582.469469:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136368000 00000100:00100000:0.0:1787853582.469516:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:0.0:1787853582.469523:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1874700136368000:12345-192.168.206.10@tcp:8:touch.500 00010000:00080000:0.0:1787853582.469553:0:6673:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:0.0:1787853582.469587:0:6673:0:(genops.c:1385:class_connect()) connect: client 0d6ecd6d-a011-4e2a-a67c-6551aba162fe, cookie 0xcf1365f7cb054a1d 00002000:00100000:0.0:1787853582.469597:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0d6ecd6d-a011-4e2a-a67c-6551aba162fe/ffff99277c19c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113953 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787853582.469609:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787853582.469893:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787853582.469923:0:6673:0:(import.c:65:import_set_state_nolock()) ffff99277c19a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853582.470003:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2361:x1874700136368000:12345-192.168.206.10@tcp:8:touch.500 Request processed in 477us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853582.470028:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:2.0:1787853582.476862:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853582.476995:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136368128 00000100:00100000:0.0:1787853582.477008:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136368128 00000100:00100000:0.0:1787853582.477109:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:0.0:1787853582.477123:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:0:x1874700136368128:12345-192.168.206.10@tcp:2:touch.500 00000100:00080000:2.0:1787853582.477538:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853582.540999:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:0:x1874700136368128:12345-192.168.206.10@tcp:2:touch.500 Request processed in 63865us (64136us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787853582.541017:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 17 00000001:00100000:2.0:1787853582.541178:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0d6ecd6d-a011-4e2a-a67c-6551aba162fe 00000001:00080000:2.0:1787853582.541199:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1787853582.552193:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853582.552713:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136368384 00000100:00100000:1.0:1787853582.552728:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136368384 00000100:00100000:1.0:1787853582.552793:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:1.0:1787853582.552803:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+10:9687:x1874700136368384:12345-192.168.206.10@tcp:35:touch.500 00000100:00100000:1.0:1787853582.553132:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+11:9687:x1874700136368384:12345-192.168.206.10@tcp:35:touch.500 Request processed in 329us (954us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787853582.553139:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:0.0:1787853582.582612:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853582.582710:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136368512 00000100:00100000:3.0:1787853582.582724:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136368512 00000100:00100000:3.0:1787853582.582807:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:3.0:1787853582.582817:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+11:9688:x1874700136368512:12345-192.168.206.10@tcp:101:rm.0 00010000:00010000:3.0:1787853582.582840:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853582.582860:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054a24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1f52 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.582921:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064de00/0xcf1365f7cb054a2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.582934:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064de00/0xcf1365f7cb054a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.582958:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064de00/0xcf1365f7cb054a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853582.583011:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787853582.583014:0:5825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853582.583049:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99275064de00/0xcf1365f7cb054a2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.583073:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054a24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f52 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.583094:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064de00/0xcf1365f7cb054a2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f52 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.583104:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff992743be3200) 00010000:00010000:3.0:1787853582.583108:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787853582.583112:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064de00, rc 0) 00000100:00100000:3.0:1787853582.583182:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+12:9688:x1874700136368512:12345-192.168.206.10@tcp:101:rm.0 Request processed in 367us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853582.583189:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:3.0:1787853582.587822:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853582.589915:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136368768 00000100:00100000:1.0:1787853582.589930:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136368768 00000100:00100000:1.0:1787853582.589998:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00100000:1.0:1787853582.590008:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+12:9688:x1874700136368768:12345-192.168.206.10@tcp:101:rm.0 00010000:00010000:1.0:1787853582.590029:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853582.590052:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb054a32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1f59 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853582.590153:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787853582.590307:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb054a32 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f59 expref: 14 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853582.590321:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992743be3600) 00010000:00010000:1.0:1787853582.590324:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787853582.590329:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb054a32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f59 expref: 14 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853582.590343:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196800, rc 0) 00000100:00100000:1.0:1787853582.590422:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+13:9688:x1874700136368768:12345-192.168.206.10@tcp:101:rm.0 Request processed in 415us (2615us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1787853582.590429:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00100000:2.0:1787853582.600209:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853582.600286:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136368896 00000100:00100000:1.0:1787853582.600295:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136368896 00000100:00100000:1.0:1787853582.600345:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:1.0:1787853582.600370:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+13:9688:x1874700136368896:12345-192.168.206.10@tcp:37:rm.0 00000100:00100000:1.0:1787853582.609103:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+13:9688:x1874700136368896:12345-192.168.206.10@tcp:37:rm.0 Request processed in 8725us (8892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853582.609117:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:3.0:1787853582.612912:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853582.613386:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136369152 00000100:00100000:1.0:1787853582.613394:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136369152 00000100:00100000:1.0:1787853582.613448:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:1.0:1787853582.613459:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274f74a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+13:9688:x1874700136369152:12345-192.168.206.10@tcp:35:rm.0 00000100:00100000:1.0:1787853582.613827:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274f74a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:9688:x1874700136369152:12345-192.168.206.10@tcp:35:rm.0 Request processed in 369us (922us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787853582.613836:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:2.0:1787853582.619491:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853582.619587:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136369408 00000100:00100000:0.0:1787853582.619596:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136369408 00000100:00100000:0.0:1787853582.619662:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:0.0:1787853582.619705:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:9688:x1874700136369408:12345-192.168.206.10@tcp:101:rm.0 00010000:00010000:0.0:1787853582.619924:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853582.620020:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054a40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1f60 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.620133:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f7000/0xcf1365f7cb054a47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.620147:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f7000/0xcf1365f7cb054a47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.620156:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f7000/0xcf1365f7cb054a47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853582.620166:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787853582.620276:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054a40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f60 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.620293:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f7000/0xcf1365f7cb054a47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f60 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.620313:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff992743be3200) 00010000:00010000:0.0:1787853582.620316:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787853582.620320:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927429f7000, rc 0) 00000100:00100000:0.0:1787853582.620512:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+16:9688:x1874700136369408:12345-192.168.206.10@tcp:101:rm.0 Request processed in 841us (1030us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787853582.620520:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:0.0:1787853582.632476:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853582.632601:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136369536 00000100:00100000:3.0:1787853582.632614:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136369536 00000100:00100000:3.0:1787853582.632727:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:3.0:1787853582.632736:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748386940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+16:9688:x1874700136369536:12345-192.168.206.10@tcp:41:rm.0 00000004:00000024:3.0:1787853582.632790:0:5826:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1787853582.632926:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748386940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+16:9688:x1874700136369536:12345-192.168.206.10@tcp:41:rm.0 Request processed in 190us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853582.632933:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:3.0:1787853582.637494:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853582.637650:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136369664 00000100:00100000:2.0:1787853582.637767:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136369664 00000100:00100000:2.0:1787853582.637826:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:2.0:1787853582.637836:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+16:9688:x1874700136369664:12345-192.168.206.10@tcp:101:rm.0 00010000:00010000:2.0:1787853582.637854:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853582.637873:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71800/0xcf1365f7cb054a55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1f67 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.637932:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054a5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.637946:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054a5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.638029:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054a5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.638047:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054a63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.638055:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.638062:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.638164:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb054a6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.638173:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb054a6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.638181:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb054a6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853582.638215:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787853582.639531:0:5825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853582.639581:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb054a6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.639597:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb054a6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.639607:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054a5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.639614:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054a5c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.639621:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054a5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.639626:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853582.639630:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054a5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.639637:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054a5c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.639650:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff992743be3200) 00010000:00010000:2.0:1787853582.639653:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853582.639658:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054a5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.639665:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054a5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.641054:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.641061:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054a63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.641067:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.641073:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71a00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853582.641077:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.641084:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054a63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.641097:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc446f69f (ffff992743be3f00) 00010000:00010000:2.0:1787853582.641100:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853582.641104:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054a63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.641109:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054a63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.641151:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71800/0xcf1365f7cb054a55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f67 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.641164:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb054a6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f67 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.641182:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff992761dc9800) 00010000:00010000:2.0:1787853582.641185:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853582.641187:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71400, rc 0) 00000100:00100000:2.0:1787853582.641339:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+17:9688:x1874700136369664:12345-192.168.206.10@tcp:101:rm.0 Request processed in 3503us (3850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853582.641349:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:2.0:1787853582.644580:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853582.644832:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136369920 00000100:00100000:3.0:1787853582.644845:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136369920 00000100:00100000:3.0:1787853582.644901:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 30 00000100:00100000:3.0:1787853582.644911:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+17:9688:x1874700136369920:12345-192.168.206.10@tcp:36:rm.0 00010000:00010000:3.0:1787853582.644961:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787853582.644986:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71400/0xcf1365f7cb054a6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f67 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.645005:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054a16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f4b expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.645015:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff992761dc9800) 00010000:00010000:3.0:1787853582.645026:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064de00/0xcf1365f7cb054a2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f52 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.645034:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff992743be3200) 00010000:00010000:3.0:1787853582.645037:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787853582.645055:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054a71 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.645066:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054a71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.645075:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054a71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.645100:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054a78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.645108:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054a78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.645114:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054a78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.645253:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054a7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.645261:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054a7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.645268:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054a7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787853582.648029:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1787853582.648044:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 276945370491ns, next at 277945367661ns, rc = 0 00010000:00010000:3.0:1787853582.648111:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054a86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.648127:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054a86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.648137:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054a86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.648146:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054a86 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.648163:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054a86 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.648170:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054a86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.648196:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787853582.648218:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054a7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.648224:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054a7f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.648230:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054a7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.648236:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064cc00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853582.648240:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054a7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.648247:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054a7f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.648258:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853582.648261:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787853582.648265:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054a7f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.648271:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054a7f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.648287:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054a71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.648298:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853582.648299:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054a71 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.648304:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054a86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.648305:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054a71 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.648311:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064dc00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853582.648311:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d000 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:3.0:1787853582.648314:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054a71 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.648314:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054a86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.648322:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054a71 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.648322:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054a86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.648330:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff992743be3200) 00010000:00010000:2.0:1787853582.648330:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853582.648333:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853582.648333:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787853582.648337:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054a71 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.648337:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054a86 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853582.648343:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054a71 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.648343:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054a86 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853582.648353:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da2344eb reply state 00000000c38e156b transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054a78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853582.648361:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787853582.648362:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853582.648366:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853582.648368:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853582.650142:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+16:9688:x1874700136369920:12345-192.168.206.10@tcp:36:rm.0 Request processed in 5223us (5559us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787853582.650153:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 30 00010000:00010000:2.0:1787853582.657718:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054a78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.657734:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054a78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.657742:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054a78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.657748:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853582.657753:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054a78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.657761:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054a78 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.657776:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc446f69f (ffff992742cdd400) 00010000:00010000:2.0:1787853582.657779:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853582.657794:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054a78 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.657802:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054a78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853582.662239:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853582.662339:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136370176 00000100:00100000:1.0:1787853582.662348:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136370176 00000100:00100000:1.0:1787853582.662590:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:1.0:1787853582.662602:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:9688:x1874700136370176:12345-192.168.206.10@tcp:35:rm.0 00000100:00100000:1.0:1787853582.662898:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+16:9688:x1874700136370176:12345-192.168.206.10@tcp:35:rm.0 Request processed in 298us (666us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787853582.662906:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:0.0:1787853582.668981:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853582.669150:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136370432 00000100:00100000:2.0:1787853582.669160:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136370432 00000100:00100000:2.0:1787853582.669217:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 31 00000100:00100000:2.0:1787853582.669239:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99275aa28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+16:9688:x1874700136370432:12345-192.168.206.10@tcp:36:rm.0 00010000:00010000:2.0:1787853582.669295:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787853582.669321:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f7000/0xcf1365f7cb054a47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f60 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.669360:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb0549e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f3d expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.669371:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff992743be3200) 00010000:00010000:2.0:1787853582.669409:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71200/0xcf1365f7cb0549a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f2f expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.669418:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992743be3600) 00010000:00010000:2.0:1787853582.669424:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853582.669447:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054a8d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.669459:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054a8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.669468:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054a8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.669479:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054a94 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.669486:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054a94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.669492:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054a94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.669853:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb054a9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.669872:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb054a9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.669881:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb054a9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853582.670528:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787853582.670546:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb054a9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.670553:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb054a9b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.670560:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb054a9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.670566:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853582.670571:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb054a9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.670578:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb054a9b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.670590:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff992743be3e00) 00010000:00010000:2.0:1787853582.670593:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787853582.670597:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb054a9b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.670603:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70800/0xcf1365f7cb054a9b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.670622:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054a8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.670642:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054a8d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.670647:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054a8d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.670652:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71a00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853582.670655:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054a8d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.670661:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054a8d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.670669:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992743be3f00) 00010000:00010000:2.0:1787853582.670711:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853582.670715:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054a8d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853582.670721:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054a8d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787853582.670733:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000300fae70 reply state 00000000e82efaae transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054a94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853582.670740:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787853582.670821:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99275aa28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:9688:x1874700136370432:12345-192.168.206.10@tcp:36:rm.0 Request processed in 1583us (1858us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787853582.670829:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 31 00010000:00010000:0.0:1787853582.673668:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054a94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.673710:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054a94 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.673718:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054a94 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.673724:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853582.673728:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054a94 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.673735:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054a94 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.673751:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff992743be3800) 00010000:00010000:0.0:1787853582.673754:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853582.673758:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054a94 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853582.673781:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054a94 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853583.174692:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853583.174718:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152129664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853583.174798:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853583.174988:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874700152129920:0@lo:400:kworker.0 00000100:00100000:3.0:1787853583.175019:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853583.175048:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787853583.175054:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152129792:0@lo:400:kworker.0 00000100:00100000:3.0:1787853583.175081:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853583.175104:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152130304:0@lo:400:kworker.0 00000100:00100000:3.0:1787853583.175140:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853583.175169:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152129792 00000100:00100000:3.0:1787853583.175175:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152129792 00000100:00100000:3.0:1787853583.175216:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787853583.175224:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3300:x1874700152129792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853583.175272:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3300:x1874700152129792:12345-0@lo:400:kworker.0 Request processed in 48us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853583.175279:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787853583.175309:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152129920 00000100:00100000:3.0:1787853583.175312:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152129920 00000100:00100000:3.0:1787853583.175334:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152130304 00000100:00100000:3.0:1787853583.175336:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152130304 00000100:00100000:3.0:1787853583.175383:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787853583.175390:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274368b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874700152129920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853583.175423:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274368b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874700152129920:12345-0@lo:400:kworker.0 Request processed in 34us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853583.175429:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787853583.175443:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787853583.175449:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642107c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152130304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853583.175484:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642107c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152130304:12345-0@lo:400:kworker.0 Request processed in 36us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853583.175490:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787853583.175521:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152129792:0@lo:400:kworker.0 00000100:00100000:0.0:1787853583.175815:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152130176:0@lo:400:kworker.0 00000100:00080000:2.0:1787853583.175879:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853583.175893:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853583.175902:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992743688f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152130048:0@lo:400:kworker.0 00000100:00100000:1.0:1787853583.176017:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152129664 00000100:00100000:1.0:1787853583.176022:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152129664 00000100:00100000:1.0:1787853583.176063:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787853583.176071:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152129664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787853583.176097:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853583.176235:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152130304:0@lo:400:kworker.0 00000100:00100000:3.0:1787853583.176246:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874700152129920:0@lo:400:kworker.0 00000100:00100000:3.0:1787853583.176305:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152130176 00000100:00100000:3.0:1787853583.176309:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152130176 00000100:00100000:3.0:1787853583.176339:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787853583.176346:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99275aa283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152130176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853583.176777:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853583.176828:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152130048 00000100:00100000:2.0:1787853583.176833:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152130048 00000100:00100000:2.0:1787853583.176870:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787853583.176879:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152130048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853583.176926:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152130048:12345-0@lo:400:kworker.0 Request processed in 49us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853583.176932:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1787853583.176949:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787853583.176953:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787853583.176955:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787853583.176973:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992743688f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152130048:0@lo:400:kworker.0 00000100:00100000:1.0:1787853583.177094:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152129664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1023us (2295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853583.177125:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1787853583.177283:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99274368b840 x1874700152129664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853583.177300:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152129664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853583.182214:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99275aa283c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152130176:12345-0@lo:400:kworker.0 Request processed in 5862us (6318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853583.182228:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1787853583.182568:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99274368ad00 x1874700152130176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853583.183073:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152130176:0@lo:400:kworker.0 00010000:00010000:1.0:1787853583.241277:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853584.264692:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853585.288874:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853585.850785:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853585.850835:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853585.850875:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853585.850907:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853585.850940:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136370816 00000100:00100000:1.0:1787853585.850954:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136370816 00000100:00100000:0.0:1787853585.850956:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136370688 00000100:00100000:0.0:1787853585.850972:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136370688 00000100:00100000:1.0:1787853585.851087:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:1.0:1787853585.851100:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99275aa2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2362:x1874700136370816:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853585.851321:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99275aa2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2362:x1874700136370816:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 223us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853585.851330:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:3.0:1787853585.851573:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136370560 00000100:00100000:3.0:1787853585.851579:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136370560 00000100:00100000:3.0:1787853585.851618:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 246 00000100:00100000:3.0:1787853585.851626:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2362:x1874700136370560:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853585.851695:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136370944 00000100:00100000:3.0:1787853585.851701:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2362:x1874700136370560:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 47us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853585.851701:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136370944 00000100:00100000:3.0:1787853585.851711:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 246 00000100:00100000:0.0:1787853585.851741:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 95 00000100:00100000:0.0:1787853585.851751:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:2362:x1874700136370688:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853585.851791:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:2362:x1874700136370688:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 43us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853585.851798:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 95 00000100:00100000:0.0:1787853585.851812:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 96 00000100:00100000:0.0:1787853585.851819:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2362:x1874700136370944:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853585.851841:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2362:x1874700136370944:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 24us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853585.853006:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 96 00000100:00080000:0.0:1787853585.853069:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787853585.853076:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1787853586.245979:0:7126:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 280543302141ns, next at 281543298979ns, rc = 0 00000100:00100000:3.0:1787853586.246070:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152130432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853586.246178:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853586.246312:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152130432 00000100:00100000:2.0:1787853586.246331:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152130432 00000100:00100000:2.0:1787853586.246424:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787853586.246437:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642105a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152130432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853586.246485:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853586.246545:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642105a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152130432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853586.246572:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1787853586.246699:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787853586.246733:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99276f6f70c0 x1874700152130432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853586.246755:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152130432:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787853586.311080:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787853586.440281:0:11597:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1787853587.335059:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787853587.581216:0:11645:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff42b9e190 20000000:00000080:3.0:1787853587.581238:0:11645:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff992775440800 uarg=0000000000000000 20000000:01000000:3.0:1787853587.581286:0:11645:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787853587.581294:0:11645:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787853587.581300:0:11645:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787853587.582584:0:11646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1787853587.582718:0:11645:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787853587.598758:0:11645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787853587.598936:0:11645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787853587.599008:0:11645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787853587.599032:0:11645:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787853587.599060:0:11645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054aa2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.599087:0:11645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff992740030a00/0xcf1365f7cb054944 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f1a expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.599096:0:11645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff992766197e00/0xcf1365f7cb05494b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f21 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.599105:0:11645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff992740030400/0xcf1365f7cb054959 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054952 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.599112:0:11645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff992740031a00/0xcf1365f7cb054967 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054960 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.599119:0:11645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff992740030600/0xcf1365f7cb054975 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05496e expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.599126:0:11645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054aa2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.599181:0:11645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff992740030600/0xcf1365f7cb054975 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb05496e expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.599200:0:11645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff992740030600/0xcf1365f7cb054975 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb05496e expref: 18 pid: 5818 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853587.599231:0:11645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642106580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11645:1874700152130560:0@lo:104: 00000100:00100000:3.0:1787853587.599324:0:11645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787853587.599473:0:11645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff992740031a00/0xcf1365f7cb054967 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb054960 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.599482:0:11645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff992740031a00/0xcf1365f7cb054967 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb054960 expref: 18 pid: 5816 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853587.599490:0:11645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9926421070c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11645:1874700152130688:0@lo:104: 00000100:00100000:3.0:1787853587.599514:0:11645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787853587.603228:0:11645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff992740030400/0xcf1365f7cb054959 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb054952 expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.603251:0:11645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff992740030400/0xcf1365f7cb054959 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb054952 expref: 18 pid: 5819 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853587.603268:0:11645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9926421052c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11645:1874700152130816:0@lo:104: 00000100:00100000:3.0:1787853587.603346:0:11645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853587.603971:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152130560 00000100:00100000:2.0:1787853587.603981:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152130560 00000100:00100000:2.0:1787853587.604042:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152130688 00000100:00100000:2.0:1787853587.604045:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152130688 00000100:00100000:2.0:1787853587.604061:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787853587.604070:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642106d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+4:11645:x1874700152130560:12345-0@lo:104: 00010000:00010000:2.0:1787853587.604087:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff992766196e00/0xcf1365f7cb05496e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054975 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853587.604168:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787853587.604174:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642106d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+4:11645:x1874700152130560:12345-0@lo:104: Request processed in 105us (4851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853587.604182:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787853587.604201:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787853587.604207:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642105680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:11645:x1874700152130688:12345-0@lo:104: 00010000:00010000:2.0:1787853587.604215:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb054960 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054967 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853587.604251:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787853587.604256:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642105680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:11645:x1874700152130688:12345-0@lo:104: Request processed in 50us (4742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853587.604262:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1787853587.606111:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787853587.606128:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff992766196e00/0xcf1365f7cb05496e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054975 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.606140:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196e00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:0.0:1787853587.606145:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff992766196e00/0xcf1365f7cb05496e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb054975 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.606155:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff992766196e00/0xcf1365f7cb05496e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb054975 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853587.606163:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff992766196e00/0xcf1365f7cb05496e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb054975 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853587.606170:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787853587.606244:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff992766196e00/0xcf1365f7cb05496e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054975 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.606251:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853587.606282:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff992766196e00/0xcf1365f7cb05496e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054975 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.606289:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff992766196e00/0xcf1365f7cb05496e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054975 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.606332:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853587.606336:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb054960 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054967 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.606342:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71000 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:0.0:1787853587.606345:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb054960 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb054967 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.606362:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb054960 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb054967 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853587.606369:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb054960 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb054967 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853587.606374:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787853587.606391:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb054960 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054967 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.606397:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853587.606403:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb054960 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054967 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.606409:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb054960 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054967 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.606419:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853587.606421:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853587.606422:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853587.606446:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152130944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853587.606535:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853587.606599:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853587.606606:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152131072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853587.606629:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853587.606667:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152130944 00000100:00100000:0.0:1787853587.606703:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152130944 00010000:00010000:0.0:1787853587.606746:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff992740030600/0xcf1365f7cb054975 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb05496e expref: 19 pid: 5818 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853587.606773:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152131072 00000100:00100000:0.0:1787853587.606777:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152131072 00010000:00010000:0.0:1787853587.606788:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff992740031a00/0xcf1365f7cb054967 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb054960 expref: 20 pid: 5816 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853587.606810:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787853587.606820:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+20:3297:x1874700152130944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853587.606835:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853587.606841:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff992740030600/0xcf1365f7cb054975 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb05496e expref: 20 pid: 5818 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.607781:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff992740030600/0xcf1365f7cb054975 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb05496e expref: 20 pid: 5818 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.607808:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853587.607995:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+20:3297:x1874700152130944:12345-0@lo:103:ldlm_bl.0 Request processed in 1175us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853587.608006:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787853587.608039:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787853587.608052:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152131072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853587.608081:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853587.608087:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff992740031a00/0xcf1365f7cb054967 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb054960 expref: 19 pid: 5816 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.608098:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff992740031a00/0xcf1365f7cb054967 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb054960 expref: 19 pid: 5816 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.608109:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853587.608134:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152131072:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853587.608141:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1787853587.610525:0:11645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff992766197e00/0xcf1365f7cb05494b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f21 expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.610551:0:11645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff992766197e00/0xcf1365f7cb05494b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f21 expref: 12 pid: 5816 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853587.610570:0:11645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927436892c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11645:1874700152131200:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787853587.610662:0:11645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff992740030a00/0xcf1365f7cb054944 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f1a expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.610715:0:11645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff992740030a00/0xcf1365f7cb054944 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f1a expref: 12 pid: 5816 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853587.610726:0:11645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11645:1874700152131328:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787853587.610745:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152130944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787853587.610762:0:11645:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276ad4cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787853587.610784:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152131072:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787853587.610785:0:11645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992740030600/0xcf1365f7cb054975 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb05496e expref: 18 pid: 5818 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853587.610807:0:11645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642106580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11645:1874700152130560:0@lo:104: 00010000:00010000:3.0:1787853587.610825:0:11645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992740031a00/0xcf1365f7cb054967 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb054960 expref: 17 pid: 5816 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853587.610835:0:11645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9926421070c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11645:1874700152130688:0@lo:104: 00000100:00100000:2.0:1787853587.610857:0:5808:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787853587.610873:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152130816 00000100:00100000:2.0:1787853587.610879:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152130816 00000100:00100000:2.0:1787853587.611253:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787853587.611265:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276d4ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:11645:x1874700152130816:12345-0@lo:104: 00010000:00010000:2.0:1787853587.611280:0:5808:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff992747f70000/0xcf1365f7cb054952 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054959 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.611885:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853587.612504:0:11645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9926421052c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11645:1874700152130816:0@lo:104: 00010000:00010000:2.0:1787853587.612551:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1787853587.612557:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787853587.612563:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276d4ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+3:11645:x1874700152130816:12345-0@lo:104: Request processed in 1298us (9214us total) trans 0 rc 0/0 00010000:00010000:0.0:1787853587.612570:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff992747f70000/0xcf1365f7cb054952 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb054959 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853587.612578:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1787853587.612587:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70000 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:0.0:1787853587.612593:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff992747f70000/0xcf1365f7cb054952 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb054959 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.612603:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff992747f70000/0xcf1365f7cb054952 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb054959 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853587.612612:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff992747f70000/0xcf1365f7cb054952 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb054959 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853587.612619:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787853587.612696:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff992747f70000/0xcf1365f7cb054952 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054959 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.612720:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853587.612752:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff992747f70000/0xcf1365f7cb054952 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054959 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.612758:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff992747f70000/0xcf1365f7cb054952 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb054959 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.612778:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853587.612780:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853587.612782:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853587.612797:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152131456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853587.612976:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853587.613244:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152131456 00000100:00100000:0.0:1787853587.613252:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152131456 00010000:00010000:0.0:1787853587.613287:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff992740030400/0xcf1365f7cb054959 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb054952 expref: 17 pid: 5819 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853587.613328:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787853587.613338:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274415f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:3299:x1874700152131456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853587.614150:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853587.614161:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff992740030400/0xcf1365f7cb054959 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb054952 expref: 17 pid: 5819 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.614177:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff992740030400/0xcf1365f7cb054959 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb054952 expref: 17 pid: 5819 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.614196:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992740030400/0xcf1365f7cb054959 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb054952 expref: 17 pid: 5819 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.614244:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853587.614314:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274415f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:3299:x1874700152131456:12345-0@lo:103:ldlm_bl.0 Request processed in 977us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853587.614323:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787853587.614413:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152131456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853587.616315:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853587.616386:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853587.616402:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136371072 00000100:00100000:2.0:1787853587.616413:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136371072 00000100:00100000:0.0:1787853587.616418:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136371200 00000100:00100000:0.0:1787853587.616424:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136371200 00010000:00010000:0.0:1787853587.616518:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff992740030a00/0xcf1365f7cb054944 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f1a expref: 14 pid: 5816 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853587.616529:0:11645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927436892c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11645:1874700152131200:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787853587.616545:0:11645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368ad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11645:1874700152131328:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787853587.616563:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:0.0:1787853587.616578:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7076e8b-41d6-499a-b764-6185164c5ac6+14:2364:x1874700136371200:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853587.616592:0:11645:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054aa2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.616596:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853587.616605:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff992740030a00/0xcf1365f7cb054944 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f1a expref: 14 pid: 5816 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.616617:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff992740030a00/0xcf1365f7cb054944 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f1a expref: 14 pid: 5816 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.616645:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992740030a00/0xcf1365f7cb054944 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f1a expref: 14 pid: 5816 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853587.616663:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff992766197e00/0xcf1365f7cb05494b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f21 expref: 13 pid: 5816 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.616664:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853587.616749:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2364:x1874700136371200:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 176us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853587.616758:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:3.0:1787853587.616794:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:3.0:1787853587.616805:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7076e8b-41d6-499a-b764-6185164c5ac6+12:2365:x1874700136371072:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853587.616817:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853587.616823:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff992766197e00/0xcf1365f7cb05494b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f21 expref: 12 pid: 5816 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.616919:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff992766197e00/0xcf1365f7cb05494b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f21 expref: 12 pid: 5816 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.616933:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992766197e00/0xcf1365f7cb05494b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f21 expref: 12 pid: 5816 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.616947:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054aa2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.616957:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054aa2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.616974:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054aa2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.616982:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054aa2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.616991:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054aa2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.616998:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054aa2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.617005:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064dc00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:3.0:1787853587.617010:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054aa2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.617020:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054aa2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.617054:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054aa2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.617065:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853587.617096:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7076e8b-41d6-499a-b764-6185164c5ac6+11:2365:x1874700136371072:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 292us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853587.617105:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 34 00010000:00010000:2.0:1787853587.617174:0:11645:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054aa2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853587.617183:0:11645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054aa2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853587.617189:0:11645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99275064dc00/0xcf1365f7cb054aa2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787853587.877623:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000001:00080000:2.0:1787853587.877641:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:2.0:1787853587.877841:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1787853587.877863:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1787853587.877875:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1787853587.878445:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dd34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152131584:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787853587.878811:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853587.879007:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152131584 00000100:00100000:3.0:1787853587.879016:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152131584 00000100:00100000:3.0:1787853587.879089:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787853587.879100:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152131584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787853587.879445:0:6671:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1787853587.879559:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a907b0e, atime: 0x6a907b0e, ctime: 0x6a907b0e, blocks: 0x1 00010000:00010000:3.0:1787853587.879569:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032b9513c/0xcf1365f7cb054aa9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.879589:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1787853587.879594:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853587.879603:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032b9513c/0xcf1365f7cb054aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.879624:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032b9513c/0xcf1365f7cb054aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.879638:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032b9513c/0xcf1365f7cb054aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.879665:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032b9513c/0xcf1365f7cb054aa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853587.879764:0:6671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853587.880026:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853587.880035:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032b9513c/0xcf1365f7cb054aa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.880045:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064cc00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853587.880050:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032b9513c/0xcf1365f7cb054aa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.880061:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032b9513c/0xcf1365f7cb054aa9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.880083:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032b9513c/0xcf1365f7cb054aa9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.880091:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032b9513c/0xcf1365f7cb054aa9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853587.880115:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853587.880117:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853587.880119:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853587.881287:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1874700152131584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2182us (2469us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787853587.881301:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1787853587.881469:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99276dd34000/2, rc 0, transno 4294967300 00000100:00100000:1.0:1787853587.881478:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dd34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152131584:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787853588.294018:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152131968:0@lo:400:kworker.0 00000100:00100000:0.0:1787853588.294129:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152131840:0@lo:400:kworker.0 00000100:00100000:0.0:1787853588.294234:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853588.294316:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787853588.294324:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152131712:0@lo:400:kworker.0 00000100:00100000:0.0:1787853588.294373:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853588.294434:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152132224:0@lo:400:kworker.0 00000100:00100000:0.0:1787853588.294469:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853588.294480:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152132096:0@lo:400:kworker.0 00000100:00100000:0.0:1787853588.294499:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152132352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853588.294522:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853588.294536:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853588.294576:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152131840 00000100:00100000:0.0:1787853588.294585:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152131840 00000100:00100000:3.0:1787853588.294840:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152132096 00000100:00100000:3.0:1787853588.294846:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152132096 00000100:00100000:0.0:1787853588.294859:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787853588.294873:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152131840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853588.294892:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787853588.294902:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927436892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152132096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853588.294943:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152131840:12345-0@lo:400:kworker.0 Request processed in 73us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853588.294951:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787853588.294978:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152132224 00000100:00100000:0.0:1787853588.294982:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152132224 00000100:00100000:0.0:1787853588.295012:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787853588.295021:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152132224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853588.295032:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927436892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152132096:12345-0@lo:400:kworker.0 Request processed in 130us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853588.295040:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1787853588.295060:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787853588.295066:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853588.295102:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152132096:0@lo:400:kworker.0 00000100:00100000:3.0:1787853588.295155:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152131712 00000100:00100000:3.0:1787853588.295159:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152131712 00000100:00100000:3.0:1787853588.295188:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787853588.295195:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:3298:x1874700152131712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853588.295227:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744146450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:3298:x1874700152131712:12345-0@lo:400:kworker.0 Request processed in 33us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853588.295247:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787853588.295262:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853588.295304:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152131968 00000100:00100000:2.0:1787853588.295309:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152131968 00000100:00100000:2.0:1787853588.295339:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787853588.295357:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152131968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853588.295393:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152131968:12345-0@lo:400:kworker.0 Request processed in 48us (132us total) trans 0 rc 0/0 00000100:00080000:3.0:1787853588.295519:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853588.295649:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152132224:12345-0@lo:400:kworker.0 Request processed in 629us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853588.295657:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787853588.295700:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152132352 00000100:00100000:0.0:1787853588.295704:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152132352 00000100:00100000:0.0:1787853588.295731:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787853588.295738:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152132352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787853588.295773:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853588.295801:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152131968:0@lo:400:kworker.0 00000100:00100000:0.0:1787853588.295813:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152132352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853588.295821:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1787853588.295863:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99274368ad00 x1874700152132352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853588.295890:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152132352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853588.295903:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152131712:0@lo:400:kworker.0 00010000:00080000:0.0:1787853588.295912:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992747b4f840 x1874700152132224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853588.295944:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152132224:0@lo:400:kworker.0 00000100:00100000:0.0:1787853588.295958:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152131840:0@lo:400:kworker.0 00000100:00100000:2.0:1787853588.296101:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00010000:0.0:1787853588.358020:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853589.177486:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853589.177646:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136371328 00000100:00100000:3.0:1787853589.177658:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136371328 00000100:00100000:3.0:1787853589.177764:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 248 00000100:00100000:3.0:1787853589.177776:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+11:5602:x1874700136371328:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853589.177798:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853589.177823:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99275064de00/0xcf1365f7cb054ab0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1f6e expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853589.177857:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99275064de00/0xcf1365f7cb054ab0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f6e expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853589.177868:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99275064de00/0xcf1365f7cb054ab0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f6e expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853589.177878:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064de00, rc 0) 00000100:00100000:3.0:1787853589.177958:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+12:5602:x1874700136371328:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 184us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853589.177966:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 248 00000100:00100000:0.0:1787853589.181090:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853589.181223:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136371456 00000100:00100000:3.0:1787853589.181235:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136371456 00000100:00100000:3.0:1787853589.181352:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 249 00000100:00100000:3.0:1787853589.181364:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+12:5602:x1874700136371456:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853589.181954:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+12:5602:x1874700136371456:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 589us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853589.181972:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 249 00000100:00100000:0.0:1787853589.186192:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853589.186308:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136371584 00000100:00100000:2.0:1787853589.186320:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136371584 00000100:00100000:2.0:1787853589.186518:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 250 00000100:00100000:2.0:1787853589.186530:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+12:5602:x1874700136371584:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853589.186870:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+12:5602:x1874700136371584:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 Request processed in 341us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853589.186879:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 250 00000100:00100000:1.0:1787853589.190033:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853589.190174:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136371712 00000100:00100000:3.0:1787853589.190185:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136371712 00000100:00100000:3.0:1787853589.190244:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 251 00000100:00100000:3.0:1787853589.190254:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+12:9958:x1874700136371712:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787853589.190549:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+12:9958:x1874700136371712:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 295us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853589.190558:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 251 00000100:00100000:0.0:1787853589.194654:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853589.194897:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136371840 00000100:00100000:3.0:1787853589.194909:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136371840 00000100:00100000:3.0:1787853589.195041:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 252 00000100:00100000:3.0:1787853589.195053:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992758772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+12:9958:x1874700136371840:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787853589.195536:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992758772850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+12:9958:x1874700136371840:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 483us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853589.195546:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 252 00000100:00100000:0.0:1787853589.200613:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853589.201178:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136371968 00000100:00100000:2.0:1787853589.201191:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136371968 00000100:00100000:2.0:1787853589.201266:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 253 00000100:00100000:2.0:1787853589.201276:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992758771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+12:5602:x1874700136371968:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853589.201297:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853589.201319:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992747f70800/0xcf1365f7cb054ab7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1f75 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853589.201391:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992747f70800/0xcf1365f7cb054ab7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f75 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853589.201414:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992747f70800/0xcf1365f7cb054ab7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f75 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853589.201424:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70800, rc 0) 00000100:00100000:2.0:1787853589.201550:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992758771450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:5602:x1874700136371968:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 275us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853589.201558:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 253 00000100:00100000:0.0:1787853589.204876:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853589.204964:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136372096 00000100:00100000:3.0:1787853589.204977:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136372096 00000100:00100000:3.0:1787853589.205042:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 254 00000100:00100000:3.0:1787853589.205053:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:5602:x1874700136372096:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853589.215961:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:5602:x1874700136372096:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 10884us (11073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853589.215981:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 254 00000100:00100000:0.0:1787853589.216560:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853589.216644:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136372224 00000100:00100000:3.0:1787853589.216654:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136372224 00000100:00100000:3.0:1787853589.216750:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 255 00000100:00100000:3.0:1787853589.216759:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+13:5602:x1874700136372224:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853589.217207:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+13:5602:x1874700136372224:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 Request processed in 446us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853589.217217:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 255 00000100:00100000:0.0:1787853589.220667:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853589.221635:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136372352 00000100:00100000:3.0:1787853589.221650:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136372352 00000100:00100000:3.0:1787853589.221740:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 256 00000100:00100000:3.0:1787853589.221749:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:9961:x1874700136372352:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787853589.223215:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:9961:x1874700136372352:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 1453us (2548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853589.223229:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 256 00000100:00100000:1.0:1787853589.226004:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853589.226104:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136372480 00000100:00100000:3.0:1787853589.226116:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136372480 00000100:00100000:3.0:1787853589.226221:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 257 00000100:00100000:3.0:1787853589.226232:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+13:9961:x1874700136372480:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787853589.226569:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743794c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+13:9961:x1874700136372480:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 338us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853589.226579:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 257 00010000:00010000:0.0:1787853589.382146:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787853589.573840:0:5821:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787853589.573850:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9927441ba000 from 7 10000000:01000000:0.0:1787853589.573857:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787853589.573928:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb054abe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853589.573942:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb054abe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853589.573955:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb054abe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853589.574007:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152132480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787853589.574102:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853589.574185:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992745a56900 going to sleep for 11 seconds 00000100:00100000:3.0:1787853589.574352:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152132480 00000100:00100000:3.0:1787853589.574363:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152132480 00000100:00100000:3.0:1787853589.574430:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787853589.574440:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:5821:x1874700152132480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853589.574455:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853589.574472:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99275064ca00/0xcf1365f7cb054ac5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb054abe expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853589.574509:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99275064ca00/0xcf1365f7cb054ac5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb054abe expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853589.574522:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99275064ca00/0xcf1365f7cb054ac5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054abe expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853589.574532:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064ca00, rc 0) 00000100:00100000:2.0:1787853589.574762:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152132480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853589.574781:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb054abe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054ac5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853589.574791:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb054abe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054ac5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853589.574829:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743796050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152132480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 390us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853589.574837:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787853589.574857:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152132608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853589.574886:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853589.574917:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992745a903c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853589.578330:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152132608 00000100:00100000:3.0:1787853589.578362:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152132608 00000100:00100000:3.0:1787853589.578452:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787853589.578463:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152132608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853589.578918:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152132608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 456us (4030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853589.578928:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787853589.579532:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152132608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853589.579601:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152132736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853589.579746:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853589.579786:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992745a903c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853589.579806:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152132736 00000100:00100000:2.0:1787853589.579819:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152132736 00000100:00100000:2.0:1787853589.579856:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787853589.579863:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152132736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853589.580902:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152132736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1031us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853589.580915:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787853589.581057:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152132736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787853589.581645:0:11661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:11661:1874700152132864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853589.581785:0:11661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853589.581820:0:11661:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277d3140c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853589.581868:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152132864 00000100:00100000:2.0:1787853589.581874:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152132864 00000100:00100000:2.0:1787853589.581915:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787853589.581922:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:11661:x1874700152132864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853589.582127:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:11661:x1874700152132864:12345-0@lo:502:llog_process_th.0 Request processed in 204us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853589.582134:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787853589.585332:0:11661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:11661:1874700152132864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787853589.585394:0:11661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853589.585406:0:11661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853589.585409:0:11661:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787853589.585416:0:11661:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9927441ba000 00000020:00000080:0.0:1787853589.585420:0:11661:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787853589.585598:0:11661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:11661:1874700152132992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853589.585669:0:11661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853589.585732:0:11661:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277d3140c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853589.585813:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152132992 00000100:00100000:2.0:1787853589.585820:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152132992 00000100:00100000:2.0:1787853589.585871:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787853589.585880:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:11661:x1874700152132992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853589.586115:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:11661:x1874700152132992:12345-0@lo:502:llog_process_th.0 Request processed in 235us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853589.586122:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787853589.586234:0:11661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:11661:1874700152132992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787853589.586256:0:11661:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853589.586261:0:11661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853589.586263:0:11661:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787853589.586269:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787853589.586738:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787853589.586758:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787853589.586767:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb054abe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054ac5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853589.586778:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb054abe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054ac5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853589.586800:0:5821:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787853589.586803:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9927660b0000 from 7 10000000:01000000:2.0:1787853589.586805:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787853589.586830:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb054acc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853589.586839:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb054acc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853589.586848:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb054acc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853589.586863:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152133120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787853589.586895:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853589.586932:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992745a90cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853589.587842:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152133120 00000100:00100000:0.0:1787853589.587850:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152133120 00000100:00100000:0.0:1787853589.587900:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787853589.587909:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:5821:x1874700152133120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853589.587922:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853589.587936:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927429f7600/0xcf1365f7cb054ad3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb054acc expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853589.587958:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927429f7600/0xcf1365f7cb054ad3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb054acc expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853589.587975:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927429f7600/0xcf1365f7cb054ad3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054acc expref: 18 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853589.587984:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927429f7600, rc 0) 00000100:00100000:0.0:1787853589.588033:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152133120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853589.588039:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787853589.588400:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152133120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853589.588416:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb054acc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054ad3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853589.588426:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb054acc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054ad3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853589.588485:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152133248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853589.588515:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853589.588549:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992745a90cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853589.588564:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152133248 00000100:00100000:2.0:1787853589.588567:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152133248 00000100:00100000:2.0:1787853589.588594:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787853589.588600:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152133248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853589.588838:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152133248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853589.588844:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787853589.588876:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152133248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853589.588904:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152133376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853589.588938:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853589.588958:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992745a90cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853589.588970:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152133376 00000100:00100000:2.0:1787853589.588973:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152133376 00000100:00100000:2.0:1787853589.588990:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787853589.588996:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152133376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853589.589529:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152133376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 532us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853589.589537:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787853589.589578:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152133376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853589.589762:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:11663:1874700152133504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853589.589795:0:11663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853589.589813:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152133504 00000100:00100000:2.0:1787853589.589817:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152133504 00000100:00100000:2.0:1787853589.589836:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787853589.589841:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:11663:x1874700152133504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787853589.589882:0:11663:0:(client.c:2715:ptlrpc_set_wait()) set ffff992745a90cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853589.590001:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:11663:x1874700152133504:12345-0@lo:502:llog_process_th.0 Request processed in 158us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853589.590013:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787853589.590047:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:11663:1874700152133504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787853589.590069:0:11663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787853589.590087:0:11663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853589.590095:0:11663:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787853589.590105:0:11663:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9927660b0000 00000020:00000080:3.0:1787853589.590107:0:11663:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787853589.590188:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:11663:1874700152133632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787853589.590222:0:11663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853589.590241:0:11663:0:(client.c:2715:ptlrpc_set_wait()) set ffff992766048540 going to sleep for 11 seconds 00000100:00100000:2.0:1787853589.590482:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152133632 00000100:00100000:2.0:1787853589.590487:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152133632 00000100:00100000:2.0:1787853589.590523:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787853589.590530:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:11663:x1874700152133632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853589.590658:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:11663:x1874700152133632:12345-0@lo:502:llog_process_th.0 Request processed in 127us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853589.590664:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787853589.590774:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:11663:1874700152133632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787853589.590794:0:11663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853589.590799:0:11663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853589.590801:0:11663:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787853589.590806:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787853589.590941:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787853589.590958:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787853589.590967:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb054acc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054ad3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853589.590976:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb054acc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054ad3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853589.590986:0:5821:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787853589.590988:0:5821:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9927436b6000 from 7 10000000:01000000:2.0:1787853589.590991:0:5821:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787853589.591014:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb054ada lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853589.591022:0:5821:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb054ada lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853589.591031:0:5821:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb054ada lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853589.591044:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152133760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787853589.591079:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853589.591157:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992746bd1540 going to sleep for 11 seconds 00000100:00100000:0.0:1787853589.591289:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152133760 00000100:00100000:0.0:1787853589.591294:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152133760 00000100:00100000:0.0:1787853589.591379:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787853589.591389:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:5821:x1874700152133760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853589.591398:0:5819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853589.591411:0:5819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927429f6600/0xcf1365f7cb054ae1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb054ada expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853589.591433:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927429f6600/0xcf1365f7cb054ae1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb054ada expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853589.591443:0:5819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927429f6600/0xcf1365f7cb054ae1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb054ada expref: 19 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853589.591452:0:5819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927429f6600, rc 0) 00000100:00100000:0.0:1787853589.592922:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152133760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1527us (1835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853589.592932:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787853589.593271:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152133760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853589.593295:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb054ada lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054ae1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853589.593307:0:5821:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb054ada lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054ae1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853589.593386:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152133888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853589.593435:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853589.593472:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992746bd1540 going to sleep for 11 seconds 00000100:00100000:0.0:1787853589.593522:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152133888 00000100:00100000:0.0:1787853589.593528:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152133888 00000100:00100000:0.0:1787853589.593576:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787853589.593585:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152133888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853589.593839:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152133888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853589.593847:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787853589.593931:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152133888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853589.594211:0:5821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152134016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853589.594250:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853589.594269:0:5821:0:(client.c:2715:ptlrpc_set_wait()) set ffff992746bd1540 going to sleep for 11 seconds 00000100:00100000:0.0:1787853589.594319:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152134016 00000100:00100000:0.0:1787853589.594324:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152134016 00000100:00100000:0.0:1787853589.594398:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787853589.594406:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152134016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787853589.594554:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:5821:x1874700152134016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853589.594561:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787853589.594628:0:5821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c912fdd2-2ba1-4aef-9721-e9a024331fd8:5821:1874700152134016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853589.594835:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:11665:1874700152134144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853589.594868:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853589.594995:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff992746bd19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853589.595163:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152134144 00000100:00100000:1.0:1787853589.595168:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152134144 00000100:00100000:1.0:1787853589.595191:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787853589.595197:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:11665:x1874700152134144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787853589.595350:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:11665:x1874700152134144:12345-0@lo:502:llog_process_th.0 Request processed in 152us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853589.595356:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787853589.595447:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:11665:1874700152134144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787853589.595469:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787853589.595477:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853589.595479:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787853589.595485:0:11665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9927436b6000 00000020:00000080:2.0:1787853589.595492:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787853589.595566:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992747b4cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:11665:1874700152134272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853589.595598:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853589.595619:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152134272 00000100:00100000:2.0:1787853589.595622:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152134272 00000100:00100000:2.0:1787853589.595639:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787853589.595645:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:11665:x1874700152134272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853589.595793:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:11665:x1874700152134272:12345-0@lo:502:llog_process_th.0 Request processed in 148us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853589.595800:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787853589.595836:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff992746bd19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853589.595846:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992747b4cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c912fdd2-2ba1-4aef-9721-e9a024331fd8:11665:1874700152134272:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787853589.595862:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853589.595866:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853589.595868:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787853589.595871:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787853589.595915:0:5821:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787853589.595930:0:5821:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787853589.595938:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb054ada lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054ae1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853589.595948:0:5821:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb054ada lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054ae1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787853589.601514:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787853590.407925:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787853590.662898:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787853590.976257:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853590.976322:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853590.976373:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853590.976376:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136372864 00000100:00100000:1.0:1787853590.976403:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136372864 00000100:00100000:2.0:1787853590.976408:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853590.976479:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:1.0:1787853590.976495:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2362:x1874700136372864:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853590.976496:0:6672:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787853590.976512:0:6672:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787853590.976589:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2362:x1874700136372864:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 95us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853590.976599:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:3.0:1787853590.977042:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136372736 00000100:00100000:3.0:1787853590.977051:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136372736 00000100:00100000:3.0:1787853590.977109:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136372992 00000100:00100000:3.0:1787853590.977112:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136372992 00000100:00100000:3.0:1787853590.977152:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 100 00000100:00100000:3.0:1787853590.977162:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2362:x1874700136372736:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787853590.977246:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2362:x1874700136372736:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 85us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853590.977254:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 100 00000100:00100000:3.0:1787853590.977271:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 101 00000100:00100000:3.0:1787853590.977279:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9926421043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2362:x1874700136372992:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787853590.977308:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9926421043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2362:x1874700136372992:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 30us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853590.977314:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 101 00000100:00080000:3.0:1787853590.977349:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787853590.977355:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853590.977376:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136372608 00000100:00100000:3.0:1787853590.977380:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136372608 00000100:00100000:3.0:1787853590.977406:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 273 00000100:00100000:3.0:1787853590.977412:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2362:x1874700136372608:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787853590.977436:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2362:x1874700136372608:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 25us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853590.977442:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 273 00000100:00100000:3.0:1787853591.366296:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9926421052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152134400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853591.366402:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853591.367486:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152134400 00000100:00100000:0.0:1787853591.367501:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152134400 00000100:00100000:0.0:1787853591.367650:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787853591.367669:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274368b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874700152134400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787853591.367743:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853591.367835:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274368b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874700152134400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 176us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853591.367847:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787853591.367953:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853591.367965:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9926421052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152134400:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787853591.429925:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853592.453905:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787853592.958253:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:2.0:1787853593.414093:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152134656:0@lo:400:kworker.0 00000100:00100000:2.0:1787853593.414183:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853593.414265:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152135168:0@lo:400:kworker.0 00000100:00100000:2.0:1787853593.414292:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853593.414336:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853593.414342:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152134784:0@lo:400:kworker.0 00000100:00100000:2.0:1787853593.414369:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853593.414491:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152134656 00000100:00100000:3.0:1787853593.414500:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152134656 00000100:00100000:3.0:1787853593.414560:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152134784 00000100:00100000:3.0:1787853593.414563:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152134784 00000100:00100000:3.0:1787853593.414609:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787853593.414619:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9926421070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152134656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853593.414715:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9926421070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152134656:12345-0@lo:400:kworker.0 Request processed in 97us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853593.414724:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787853593.414742:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787853593.414749:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642106d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152134784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853593.414778:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642106d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152134784:12345-0@lo:400:kworker.0 Request processed in 30us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853593.414785:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1787853593.414812:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853593.414902:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152134784:0@lo:400:kworker.0 00000100:00100000:2.0:1787853593.414913:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152134656:0@lo:400:kworker.0 00000100:00100000:1.0:1787853593.415145:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152134912:0@lo:400:kworker.0 00000100:00100000:1.0:1787853593.415182:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853593.415234:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787853593.415241:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992743688f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152134528:0@lo:400:kworker.0 00000100:00100000:1.0:1787853593.415295:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853593.415341:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152135040:0@lo:400:kworker.0 00000100:00100000:2.0:1787853593.415451:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152134528 00000100:00100000:2.0:1787853593.415456:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152134528 00000100:00100000:2.0:1787853593.415490:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787853593.415496:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152134528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853593.415533:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152134528:12345-0@lo:400:kworker.0 Request processed in 36us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853593.415539:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787853593.415705:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152135168 00000100:00100000:3.0:1787853593.415717:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152135168 00000100:00100000:3.0:1787853593.415773:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152134912 00000100:00100000:3.0:1787853593.415782:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152134912 00000100:00100000:3.0:1787853593.415804:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787853593.415811:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642106580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152135168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853593.415865:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642106580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152135168:12345-0@lo:400:kworker.0 Request processed in 55us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853593.415871:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787853593.415882:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787853593.415888:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd35a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152134912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853593.415915:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd35a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152134912:12345-0@lo:400:kworker.0 Request processed in 28us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853593.415920:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1787853593.415962:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277bc3cf00 x1874700152135168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853593.415975:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152135168:0@lo:400:kworker.0 00000100:00080000:2.0:1787853593.416049:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787853593.416054:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787853593.416272:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853593.416325:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1787853593.416332:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99276dd34000, transno 4294967300 00000100:00100000:1.0:1787853593.416351:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152134912:0@lo:400:kworker.0 00000100:00100000:1.0:1787853593.416373:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992743688f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152134528:0@lo:400:kworker.0 00000100:00100000:0.0:1787853593.417439:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dd370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152135296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853593.417498:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853593.417745:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152135296 00000100:00100000:2.0:1787853593.417754:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152135296 00000100:00100000:2.0:1787853593.417818:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787853593.417827:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152135296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853593.417872:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853593.418023:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152135040 00000100:00100000:3.0:1787853593.418028:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152135040 00000100:00100000:3.0:1787853593.418081:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787853593.418088:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152135040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853593.418133:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152135040:12345-0@lo:400:kworker.0 Request processed in 45us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853593.418140:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1787853593.418279:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853593.421153:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152135040:0@lo:400:kworker.0 00000100:00100000:2.0:1787853593.421669:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152135296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3839us (4165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853593.421697:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1787853593.422038:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99276dd370c0 x1874700152135296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853593.422090:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dd370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152135296:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787853593.477930:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853594.503267:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853595.526966:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853596.090904:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853596.090954:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853596.090994:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853596.091033:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853596.091130:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136373248 00000100:00100000:0.0:1787853596.091139:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136373248 00000100:00100000:0.0:1787853596.091203:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136373504 00000100:00100000:0.0:1787853596.091207:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136373504 00000100:00100000:0.0:1787853596.091249:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 105 00000100:00100000:0.0:1787853596.091259:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136373248:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853596.091342:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136373248:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 83us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853596.091448:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 105 00000100:00100000:0.0:1787853596.091467:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 106 00000100:00100000:0.0:1787853596.091476:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2365:x1874700136373504:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853596.091506:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2365:x1874700136373504:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 32us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853596.091512:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 106 00000100:00100000:2.0:1787853596.091966:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136373120 00000100:00100000:2.0:1787853596.091972:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136373120 00000100:00100000:2.0:1787853596.092013:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 275 00000100:00100000:2.0:1787853596.092021:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2365:x1874700136373120:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853596.092058:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2365:x1874700136373120:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 38us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853596.092065:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 275 00000100:00080000:1.0:1787853596.092594:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853596.092810:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136373376 00000100:00100000:3.0:1787853596.092816:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136373376 00000100:00100000:3.0:1787853596.092875:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:3.0:1787853596.092885:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136373376:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787853596.092941:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136373376:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 58us (1985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853596.092948:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00080000:1.0:1787853596.093294:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853596.485949:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853596.490830:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642105680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152135424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853596.490900:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853596.492282:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152135424 00000100:00100000:1.0:1787853596.492350:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152135424 00000100:00100000:1.0:1787853596.492724:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787853596.492734:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152135424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787853596.492770:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853596.492848:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152135424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853596.492855:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787853596.492941:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642105680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152135424:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787853596.493241:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787853596.550092:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853597.574745:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853598.534085:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276ae0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152135552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853598.534166:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853598.534332:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152135552 00000100:00100000:2.0:1787853598.534340:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152135552 00000100:00080000:1.0:1787853598.534400:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787853598.534421:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787853598.534431:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748386580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152135552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853598.534467:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853598.534526:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748386580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152135552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853598.534534:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1787853598.534726:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99276ae0f480 x1874700152135552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853598.534744:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276ae0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152135552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853598.536948:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927500d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152135680:0@lo:400:kworker.0 00000100:00100000:3.0:1787853598.537016:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853598.537508:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927500d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152135936:0@lo:400:kworker.0 00000100:00100000:0.0:1787853598.537542:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853598.537568:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787853598.537575:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927500d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152136064:0@lo:400:kworker.0 00000100:00100000:0.0:1787853598.537600:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853598.537713:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927500d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152135808:0@lo:400:kworker.0 00000100:00100000:1.0:1787853598.537743:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853598.537841:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787853598.537879:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152135680 00000100:00100000:2.0:1787853598.537887:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152135680 00000100:00100000:1.0:1787853598.537914:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927500d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1874700152136192:0@lo:400:kworker.0 00000100:00100000:1.0:1787853598.538008:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853598.538058:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152135936 00000100:00100000:1.0:1787853598.538063:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152135936 00000100:00100000:2.0:1787853598.538113:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787853598.538125:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152135680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853598.538170:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152135808 00000100:00100000:1.0:1787853598.538175:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152135808 00000100:00100000:2.0:1787853598.538180:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152135680:12345-0@lo:400:kworker.0 Request processed in 56us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853598.538195:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152136192 00000100:00100000:1.0:1787853598.538201:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152136192 00000100:00100000:2.0:1787853598.538205:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787853598.538308:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787853598.538316:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152135936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853598.538357:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152135936:12345-0@lo:400:kworker.0 Request processed in 42us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853598.538371:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787853598.538378:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927500d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152135680:0@lo:400:kworker.0 00000100:00100000:1.0:1787853598.538390:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787853598.538397:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276ae0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152135808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853598.538442:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276ae0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152135808:12345-0@lo:400:kworker.0 Request processed in 46us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853598.538448:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787853598.538458:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787853598.538463:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276ae0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874700152136192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853598.538489:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276ae0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874700152136192:12345-0@lo:400:kworker.0 Request processed in 25us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853598.538495:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1787853598.538518:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853598.538524:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927500d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152135936:0@lo:400:kworker.0 00000100:00100000:1.0:1787853598.538543:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927500d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1874700152136192:0@lo:400:kworker.0 00000100:00100000:1.0:1787853598.538558:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927500d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152135808:0@lo:400:kworker.0 00000100:00100000:0.0:1787853598.538561:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152136064 00000100:00100000:0.0:1787853598.538566:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152136064 00000100:00080000:1.0:1787853598.538593:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853598.539138:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787853598.539153:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152136064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853598.539388:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152136064:12345-0@lo:400:kworker.0 Request processed in 241us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853598.539422:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927500d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152136064:0@lo:400:kworker.0 00000100:00100000:0.0:1787853598.541940:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:2.0:1787853598.598280:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853599.621852:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853600.648375:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787853600.903198:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787853601.210486:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853601.210591:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853601.210634:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853601.210771:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136373760 00000100:00100000:2.0:1787853601.210780:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136373760 00000100:00100000:0.0:1787853601.210902:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853601.210926:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136373632 00000100:00100000:0.0:1787853601.210929:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136373632 00000100:00100000:0.0:1787853601.211063:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 277 00000100:00100000:0.0:1787853601.211078:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2363:x1874700136373632:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853601.211145:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2363:x1874700136373632:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 71us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853601.211152:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 277 00000100:00100000:1.0:1787853601.211266:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136374016 00000100:00100000:1.0:1787853601.211270:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136374016 00000100:00100000:0.0:1787853601.211333:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136373888 00000100:00100000:2.0:1787853601.211359:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 110 00000100:00100000:2.0:1787853601.211367:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2363:x1874700136373760:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853601.211396:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136373888 00000100:00100000:2.0:1787853601.211438:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2363:x1874700136373760:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 72us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853601.211444:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 110 00000100:00080000:3.0:1787853601.212095:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787853601.212100:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853601.212120:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 54 00000100:00100000:0.0:1787853601.212142:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2363:x1874700136373888:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853601.212189:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2363:x1874700136373888:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 61us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853601.212196:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 54 00000100:00100000:1.0:1787853601.212766:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 111 00000100:00100000:1.0:1787853601.212776:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2363:x1874700136374016:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853601.213111:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2363:x1874700136374016:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 335us (2518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853601.213118:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 111 00000100:00100000:3.0:1787853601.606067:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853601.606089:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9926421052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152136320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853601.606167:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853601.606305:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152136320 00000100:00100000:2.0:1787853601.606313:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152136320 00000100:00100000:2.0:1787853601.606387:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787853601.606395:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152136320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853601.606426:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853601.606474:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152136320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853601.606480:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787853601.606524:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9926421052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152136320:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787853601.606712:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787853601.670165:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853602.693931:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853603.653918:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927500d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152136704:0@lo:400:kworker.0 00000100:00100000:0.0:1787853603.653980:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853603.654036:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853603.654042:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927500d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152136832:0@lo:400:kworker.0 00000100:00100000:0.0:1787853603.654063:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853603.654095:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152136704 00000100:00100000:0.0:1787853603.654102:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152136704 00000100:00100000:0.0:1787853603.654153:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787853603.654174:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152136704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853603.654223:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152136704:12345-0@lo:400:kworker.0 Request processed in 62us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853603.654230:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787853603.654289:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927500d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152136704:0@lo:400:kworker.0 00000100:00100000:0.0:1787853603.654311:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152136832 00000100:00100000:0.0:1787853603.654324:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152136832 00000100:00100000:0.0:1787853603.654350:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787853603.654357:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152136832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853603.654391:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152136832:12345-0@lo:400:kworker.0 Request processed in 36us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853603.654412:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787853603.654437:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927500d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152136832:0@lo:400:kworker.0 00000100:00100000:3.0:1787853603.654632:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927500d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152136448:0@lo:400:kworker.0 00000100:00100000:3.0:1787853603.654668:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853603.654724:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927500d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152136960:0@lo:400:kworker.0 00000100:00100000:3.0:1787853603.654773:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853603.654797:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787853603.654804:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927500d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152136576:0@lo:400:kworker.0 00000100:00100000:3.0:1787853603.654827:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853603.654841:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927500d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152137088:0@lo:400:kworker.0 00000100:00100000:3.0:1787853603.654862:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787853603.654886:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787853603.654890:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853603.654906:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152136960 00000100:00100000:3.0:1787853603.654911:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152136960 00000100:00100000:3.0:1787853603.654942:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152136576 00000100:00100000:3.0:1787853603.654945:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152136576 00000100:00100000:3.0:1787853603.654962:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787853603.654968:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152136960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853603.655012:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152136960:12345-0@lo:400:kworker.0 Request processed in 42us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853603.655019:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787853603.655033:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787853603.655039:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152136576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853603.655068:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152136576:12345-0@lo:400:kworker.0 Request processed in 29us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853603.655074:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1787853603.655091:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853603.655099:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152137088 00000100:00100000:3.0:1787853603.655102:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152137088 00000100:00100000:3.0:1787853603.655133:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787853603.655142:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152137088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853603.655160:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927500d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152136576:0@lo:400:kworker.0 00000100:00100000:3.0:1787853603.655181:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152137088:12345-0@lo:400:kworker.0 Request processed in 40us (316us total) trans 0 rc 0/0 00010000:00080000:2.0:1787853603.655182:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9927500d1a40 x1874700152137088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787853619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853603.655195:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787853603.655210:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927500d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152137088:0@lo:400:kworker.0 00000100:00080000:3.0:1787853603.655213:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787853603.655479:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927500d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152136960:0@lo:400:kworker.0 00000100:00100000:0.0:1787853603.655775:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152136448 00000100:00100000:0.0:1787853603.655780:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152136448 00000100:00100000:0.0:1787853603.655820:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787853603.655829:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152136448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853603.655875:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152136448:12345-0@lo:400:kworker.0 Request processed in 47us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853603.655880:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787853603.656329:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927500d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152136448:0@lo:400:kworker.0 00000100:00100000:2.0:1787853603.657473:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bf5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152137216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853603.657531:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853603.658257:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152137216 00000100:00100000:3.0:1787853603.658280:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152137216 00000100:00100000:3.0:1787853603.658346:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787853603.658355:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9926421052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152137216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787853603.658390:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853603.658455:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9926421052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152137216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853603.658463:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1787853603.658501:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277bf5d2c0 x1874700152137216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853619 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853603.658521:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bf5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152137216:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787853603.717983:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853604.741962:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853605.765958:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853606.335970:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853606.336015:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853606.336092:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136374144 00000100:00100000:0.0:1787853606.336101:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136374144 00000100:00100000:0.0:1787853606.336167:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 279 00000100:00100000:0.0:1787853606.336178:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2365:x1874700136374144:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853606.336268:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2365:x1874700136374144:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 92us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853606.336276:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 279 00000100:00100000:3.0:1787853606.336648:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136374272 00000100:00100000:3.0:1787853606.336653:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136374272 00000100:00100000:3.0:1787853606.336737:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 115 00000100:00100000:3.0:1787853606.336745:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642105680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136374272:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787853606.336777:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642105680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136374272:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 34us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853606.336783:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 115 00000100:00080000:2.0:1787853606.336837:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853606.347486:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853606.347547:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853606.347646:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136374400 00000100:00100000:2.0:1787853606.347655:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136374400 00000100:00100000:2.0:1787853606.347765:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:2.0:1787853606.347775:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2361:x1874700136374400:12345-192.168.206.10@tcp:9:kworker.0 00000020:00000080:2.0:1787853606.347802:0:11669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb054a1d 00000100:00080000:2.0:1787853606.347810:0:11669:0:(import.c:65:import_set_state_nolock()) ffff99277c19a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787853606.347846:0:11669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1787853606.348091:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+2:2361:x1874700136374400:12345-192.168.206.10@tcp:9:kworker.0 Request processed in 317us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853606.348100:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 19 00010000:00010000:2.0:1787853606.348121:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787853606.348488:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853606.348725:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136374528 00000100:00100000:3.0:1787853606.348741:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136374528 00000100:00100000:3.0:1787853606.348797:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 116 00000100:00100000:3.0:1787853606.348805:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2365:x1874700136374528:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787853606.348859:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2365:x1874700136374528:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 56us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853606.348866:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 116 00000100:00080000:0.0:1787853606.348952:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853606.727326:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152137344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853606.727407:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853606.727989:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152137344 00000100:00100000:2.0:1787853606.727998:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152137344 00000100:00100000:2.0:1787853606.728080:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787853606.728089:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276ae0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152137344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853606.728121:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853606.728178:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276ae0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152137344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (770us total) trans 0 rc 0/0 00000100:00080000:0.0:1787853606.728192:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853606.728202:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787853606.729717:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152137344:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787853606.790044:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853607.815265:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787853608.335165:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0d6ecd6d-a011-4e2a-a67c-6551aba162fe 00000020:00000080:3.0:1787853608.335174:0:6697:0:(genops.c:885:class_export_put()) final put ffff99277c19c000/0d6ecd6d-a011-4e2a-a67c-6551aba162fe 00000020:00000080:2.0:1787853608.335322:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99277c19c000/0d6ecd6d-a011-4e2a-a67c-6551aba162fe for lustre-OST0000 00000020:00000080:2.0:1787853608.335439:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99277c19a000 for lustre-OST0000 00000100:00100000:1.0:1787853608.773872:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787853608.773894:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bf5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152137472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853608.773961:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853608.774137:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152137472 00000100:00100000:3.0:1787853608.774144:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152137472 00000100:00100000:3.0:1787853608.774219:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787853608.774228:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276ae0e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152137472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787853608.774275:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853608.774324:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276ae0e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152137472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853608.774331:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1787853608.774374:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277bf5cb40 x1874700152137472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853624 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853608.774393:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bf5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152137472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853608.774603:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bf5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152137728:0@lo:400:kworker.0 00000100:00100000:3.0:1787853608.774633:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853608.774653:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853608.774658:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bf5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152137856:0@lo:400:kworker.0 00000100:00100000:3.0:1787853608.774703:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853608.774731:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152137728 00000100:00100000:3.0:1787853608.774734:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152137728 00000100:00100000:3.0:1787853608.774759:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152137856 00000100:00100000:3.0:1787853608.774761:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152137856 00000100:00100000:3.0:1787853608.774782:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787853608.774790:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152137728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853608.774829:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152137728:12345-0@lo:400:kworker.0 Request processed in 39us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853608.774834:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787853608.774846:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787853608.774852:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152137856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853608.774880:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152137856:12345-0@lo:400:kworker.0 Request processed in 29us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853608.774894:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787853608.774928:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bf5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152137856:0@lo:400:kworker.0 00000100:00100000:3.0:1787853608.774938:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bf5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152137728:0@lo:400:kworker.0 00000100:00100000:0.0:1787853608.775010:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bf5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152137984:0@lo:400:kworker.0 00000100:00100000:0.0:1787853608.775054:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853608.775088:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787853608.775094:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bf5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152137600:0@lo:400:kworker.0 00000100:00100000:0.0:1787853608.775121:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853608.775146:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bf5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152138112:0@lo:400:kworker.0 00000100:00100000:0.0:1787853608.775169:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853608.775194:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152138112 00000100:00100000:0.0:1787853608.775198:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152138112 00000100:00100000:0.0:1787853608.775229:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787853608.775256:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152138112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853608.775295:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152138112:12345-0@lo:400:kworker.0 Request processed in 57us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853608.775301:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787853608.775317:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152137600 00000100:00100000:0.0:1787853608.775322:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152137600 00000100:00100000:0.0:1787853608.775344:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787853608.775351:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152137600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853608.775378:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152137600:12345-0@lo:400:kworker.0 Request processed in 29us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853608.775383:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787853608.775417:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bf5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152137600:0@lo:400:kworker.0 00000100:00100000:0.0:1787853608.775428:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bf5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152138112:0@lo:400:kworker.0 00000100:00080000:1.0:1787853608.775561:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853608.775567:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787853608.776118:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152137984 00000100:00100000:3.0:1787853608.776124:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152137984 00000100:00100000:3.0:1787853608.776179:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787853608.776187:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152137984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853608.776245:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152137984:12345-0@lo:400:kworker.0 Request processed in 48us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853608.776251:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1787853608.776309:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853608.777208:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bf5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152137984:0@lo:400:kworker.0 00010000:00010000:0.0:1787853608.841109:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853609.862896:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787853610.123027:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787853610.886070:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853611.450832:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853611.450943:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136374656 00000100:00100000:3.0:1787853611.450952:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136374656 00000100:00100000:3.0:1787853611.451003:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 281 00000100:00100000:3.0:1787853611.451013:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2364:x1874700136374656:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787853611.451076:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2364:x1874700136374656:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 65us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853611.451084:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 281 00000100:00100000:3.0:1787853611.462697:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853611.462779:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853611.462807:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136374784 00000100:00100000:3.0:1787853611.462815:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136374784 00000100:00100000:3.0:1787853611.462875:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136374912 00000100:00100000:3.0:1787853611.462878:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136374912 00000100:00100000:3.0:1787853611.462900:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 120 00000100:00100000:3.0:1787853611.462909:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136374784:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787853611.462991:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136374784:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 83us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853611.462999:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 120 00000100:00100000:3.0:1787853611.463018:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 121 00000100:00100000:3.0:1787853611.463024:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2364:x1874700136374912:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787853611.463051:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2364:x1874700136374912:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 27us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853611.463057:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 121 00000100:00080000:1.0:1787853611.463719:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1787853611.839069:0:11831:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 14:00:10 (1787853610) 00000100:00100000:1.0:1787853611.845946:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787853611.845970:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992743688f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152138240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853611.846038:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853611.846135:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152138240 00000100:00100000:2.0:1787853611.846143:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152138240 00000100:00100000:2.0:1787853611.846203:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787853611.846211:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276ae0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152138240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853611.846322:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853611.846372:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276ae0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152138240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853611.846380:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787853611.846426:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992743688f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152138240:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787853611.846482:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787853611.909870:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853612.934382:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853613.363538:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853613.363715:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136375040 00000100:00100000:0.0:1787853613.363730:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136375040 00000100:00100000:0.0:1787853613.363834:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:0.0:1787853613.363851:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:10229:x1874700136375040:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853613.363882:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853613.363910:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f7000/0xcf1365f7cb054ae8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1f7c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.363996:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054aef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.364014:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054aef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.364030:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054aef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787853613.364387:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1787853613.364737:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787853613.364743:0:7618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853613.364865:0:7618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054aef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.364904:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f7000/0xcf1365f7cb054ae8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f7c expref: 7 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.364925:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054aef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f7c expref: 6 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.364936:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992761dc9500) 00010000:00010000:0.0:1787853613.364948:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787853613.364953:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927429f6800, rc 0) 00000100:00100000:0.0:1787853613.365037:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:10229:x1874700136375040:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 1193us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853613.365047:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:0.0:1787853613.372025:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853613.372235:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136375168 00000100:00100000:2.0:1787853613.372262:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136375168 00000100:00100000:2.0:1787853613.372336:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:2.0:1787853613.372348:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:10230:x1874700136375168:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853613.372374:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853613.372402:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb054af6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1f83 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.372489:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054afd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.372507:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054afd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.372543:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054afd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.372561:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054b04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.372569:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054b04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.372575:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054b04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.373665:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71200/0xcf1365f7cb054b0b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.373718:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71200/0xcf1365f7cb054b0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.373729:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71200/0xcf1365f7cb054b0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853613.373974:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787853613.373980:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853613.374402:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71200/0xcf1365f7cb054b0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.374419:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054afd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.374426:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054afd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.374448:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054afd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.374455:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853613.374460:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054afd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.374469:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054afd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.374485:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992761dc9500) 00010000:00010000:2.0:1787853613.374489:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853613.374494:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054afd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.374501:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054afd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.374518:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054b04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.374525:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054b04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.374531:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054b04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.374537:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853613.374540:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054b04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.374557:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054b04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.374567:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff992743be3e00) 00010000:00010000:2.0:1787853613.374570:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853613.374574:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054b04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.374580:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054b04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.374629:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb054af6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f83 expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.374645:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71200/0xcf1365f7cb054b0b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f83 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853613.374653:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff992743be3f00) 00010000:00010000:2.0:1787853613.374655:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853613.374658:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71200, rc 0) 00000100:00100000:2.0:1787853613.374853:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:10230:x1874700136375168:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 2506us (2842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853613.374864:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:1.0:1787853613.387309:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853613.387896:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136375424 00000100:00100000:0.0:1787853613.387910:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136375424 00000100:00100000:0.0:1787853613.387981:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:0.0:1787853613.387993:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276ae0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:10230:x1874700136375424:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853613.388019:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853613.388042:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f7000/0xcf1365f7cb054b12 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1f8a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.388146:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b19 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.388166:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.388179:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.388197:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b20 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.388203:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.388220:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.390484:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030a00/0xcf1365f7cb054b27 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.390512:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740030a00/0xcf1365f7cb054b27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.390525:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740030a00/0xcf1365f7cb054b27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853613.390539:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787853613.393611:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.393632:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b19 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.393641:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b19 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.393648:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031a00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853613.393654:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b19 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.393662:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b19 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.393701:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff992743be3f00) 00010000:00010000:0.0:1787853613.393705:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853613.393711:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b19 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.393740:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b19 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.393758:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.393765:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b20 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.393771:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b20 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.393777:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740030600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853613.393780:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b20 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.393787:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b20 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.393795:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff992761dc9b00) 00010000:00010000:0.0:1787853613.393798:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853613.393802:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b20 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.393809:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b20 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.397821:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f7000/0xcf1365f7cb054b12 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f8a expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.397858:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030a00/0xcf1365f7cb054b27 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f8a expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853613.397881:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff992761dc9700) 00010000:00010000:0.0:1787853613.397885:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853613.397889:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992740030a00, rc 0) 00000100:00100000:0.0:1787853613.398040:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276ae0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:10230:x1874700136375424:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 10047us (10741us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787853613.398050:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:3.0:1787853613.418040:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853613.418479:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136375552 00000100:00100000:0.0:1787853613.418492:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136375552 00000100:00100000:0.0:1787853613.418621:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:0.0:1787853613.418632:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:10230:x1874700136375552:12345-192.168.206.10@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787853613.418873:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:10230:x1874700136375552:12345-192.168.206.10@tcp:59:lhsmtool_posix.0 Request processed in 242us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853613.418882:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:2.0:1787853613.894621:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853613.894652:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99274368b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152138368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853613.894767:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853613.894852:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152138368 00000100:00100000:2.0:1787853613.894861:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152138368 00000100:00100000:2.0:1787853613.894942:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787853613.894952:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992743688f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152138368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853613.894994:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853613.895045:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992743688f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152138368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853613.895053:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1787853613.895101:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99274368b480 x1874700152138368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853629 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853613.895121:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99274368b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152138368:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787853613.896793:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787853613.896814:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276ae0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874700152138624:0@lo:400:kworker.0 00000100:00100000:1.0:1787853613.896892:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853613.896934:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787853613.896940:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276ae0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152138496:0@lo:400:kworker.0 00000100:00100000:1.0:1787853613.896972:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853613.896999:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276ae0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152139008:0@lo:400:kworker.0 00000100:00100000:1.0:1787853613.897023:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853613.897055:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152138624 00000100:00100000:1.0:1787853613.897062:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152138624 00000100:00100000:1.0:1787853613.897120:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152139008 00000100:00100000:1.0:1787853613.897123:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152139008 00000100:00100000:1.0:1787853613.897162:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787853613.897170:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276ae0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874700152138624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853613.897231:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276ae0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874700152138624:12345-0@lo:400:kworker.0 Request processed in 61us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853613.897239:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787853613.897256:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787853613.897263:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276ae0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152139008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853613.897292:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276ae0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152139008:12345-0@lo:400:kworker.0 Request processed in 31us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853613.897297:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787853613.897316:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152138496 00000100:00100000:1.0:1787853613.897319:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152138496 00000100:00100000:1.0:1787853613.897346:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787853613.897352:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3300:x1874700152138496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853613.897382:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3300:x1874700152138496:12345-0@lo:400:kworker.0 Request processed in 30us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853613.897388:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:1.0:1787853613.897414:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853613.897444:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276ae0f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152138496:0@lo:400:kworker.0 00000100:00100000:1.0:1787853613.897456:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276ae0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152139008:0@lo:400:kworker.0 00000100:00100000:1.0:1787853613.897464:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276ae0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874700152138624:0@lo:400:kworker.0 00000100:00100000:1.0:1787853613.897511:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276ae0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152138880:0@lo:400:kworker.0 00000100:00100000:1.0:1787853613.897540:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853613.897563:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787853613.897569:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276ae0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1874700152138752:0@lo:400:kworker.0 00000100:00100000:1.0:1787853613.897601:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853613.897630:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152138880 00000100:00100000:1.0:1787853613.897634:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152138880 00000100:00100000:1.0:1787853613.897705:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787853613.897713:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276ae0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152138880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853613.897749:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276ae0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152138880:12345-0@lo:400:kworker.0 Request processed in 38us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853613.897755:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787853613.897770:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152138752 00000100:00100000:1.0:1787853613.897774:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152138752 00000100:00100000:1.0:1787853613.897795:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787853613.897800:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276ae0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874700152138752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853613.897828:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276ae0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874700152138752:12345-0@lo:400:kworker.0 Request processed in 27us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853613.897834:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1787853613.897852:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853613.897855:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853613.897871:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276ae0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1874700152138752:0@lo:400:kworker.0 00000100:00100000:1.0:1787853613.897880:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276ae0de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152138880:0@lo:400:kworker.0 00010000:00010000:3.0:1787853613.958924:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787853614.214602:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787853614.983801:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853615.746507:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853615.746630:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136375680 00000100:00100000:1.0:1787853615.746639:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136375680 00000100:00100000:1.0:1787853615.746735:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:1.0:1787853615.746744:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:10273:x1874700136375680:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787853615.746764:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853615.746783:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb054b35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1f91 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.746868:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054b3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.746892:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054b3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.746904:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054b3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.746917:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb054b43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.746924:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb054b43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.746930:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb054b43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.747169:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054b3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.747177:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054b3c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.747183:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054b3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.747189:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853615.747193:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054b3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.747220:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054b3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.747233:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992761dc9500) 00010000:00010000:1.0:1787853615.747236:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853615.747240:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054b3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.747247:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054b3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.747260:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb054b43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.747266:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb054b43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.747272:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb054b43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.747277:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853615.747280:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb054b43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.747286:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb054b43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.747294:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9927433f1600) 00010000:00010000:1.0:1787853615.747296:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853615.747299:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb054b43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.747314:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb054b43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.747346:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb054b35 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f91 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.747356:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992761dc9500) 00010000:00010000:1.0:1787853615.747358:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853615.747361:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb054b35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f91 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.747371:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196600, rc 0) 00000100:00100000:1.0:1787853615.747432:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:10273:x1874700136375680:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 689us (934us total) trans 0 rc 301/301 00000100:00100000:1.0:1787853615.747440:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00080000:0.0:1787853615.747861:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853615.755191:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853615.755462:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136375936 00000100:00100000:0.0:1787853615.755480:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136375936 00000100:00100000:0.0:1787853615.755559:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:0.0:1787853615.755571:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276ae0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:10273:x1874700136375936:12345-192.168.206.10@tcp:36:lfs.0 00010000:00010000:0.0:1787853615.755656:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853615.756028:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054aef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f7c expref: 9 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.756055:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992761dc9500) 00010000:00010000:0.0:1787853615.756085:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853615.756423:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b4a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.756514:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.756526:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.756542:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b51 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.756550:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.756557:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853615.758351:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787853615.758372:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.758383:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b4a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.758392:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b4a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.758398:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031a00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853615.758404:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b4a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.758426:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b4a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.758446:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992761dc9c00) 00010000:00010000:0.0:1787853615.758449:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853615.758454:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b4a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.758460:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b4a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787853615.758485:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000789899b1 reply state 0000000089fafcb0 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853615.758496:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787853615.758944:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276ae0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+10:10273:x1874700136375936:12345-192.168.206.10@tcp:36:lfs.0 Request processed in 3369us (3755us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787853615.759016:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 37 00010000:00010000:2.0:1787853615.761831:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.761848:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b51 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.761857:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b51 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.761864:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740030600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853615.761869:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b51 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.761878:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b51 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.761897:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff992761dc9400) 00010000:00010000:2.0:1787853615.761901:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853615.761907:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b51 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.762135:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b51 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853615.869283:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853615.869589:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136376064 00000100:00100000:2.0:1787853615.869598:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136376064 00000100:00100000:2.0:1787853615.869659:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:2.0:1787853615.869669:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276ae0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:10281:x1874700136376064:12345-192.168.206.10@tcp:101:lctl.0 00010000:00010000:2.0:1787853615.869727:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853615.869750:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054b58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1f98 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.869943:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.869966:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.869981:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853615.870058:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787853615.870063:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853615.870111:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.870161:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054b58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f98 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.870183:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f98 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.870206:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992743be3e00) 00010000:00010000:0.0:1787853615.870216:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787853615.870220:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992740031a00, rc 0) 00000100:00100000:0.0:1787853615.870313:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276ae0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+10:10281:x1874700136376064:12345-192.168.206.10@tcp:101:lctl.0 Request processed in 644us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853615.870322:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:1.0:1787853615.936739:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853615.936873:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136376192 00000100:00100000:0.0:1787853615.936886:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136376192 00000100:00100000:0.0:1787853615.936963:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:0.0:1787853615.936976:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276ae0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+10:10287:x1874700136376192:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787853615.937002:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853615.937027:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054b66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1f9f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937108:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054b6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937125:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054b6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937138:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054b6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937171:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054b74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937179:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054b74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937186:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054b74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937353:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937363:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937371:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853615.937426:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787853615.937431:0:5825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853615.937600:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937616:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054b6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937624:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054b6d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937631:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054b6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937649:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853615.937655:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054b6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937664:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054b6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937852:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992743be3e00) 00010000:00010000:0.0:1787853615.937856:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853615.937862:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054b6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937869:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054b6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937887:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054b74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937893:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054b74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937899:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054b74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937905:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853615.937907:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054b74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937914:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054b74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937934:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff992761dc9c00) 00010000:00010000:0.0:1787853615.937937:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853615.937940:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054b74 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937946:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054b74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.937988:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054b66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f9f expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.938006:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f9f expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.938014:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:0.0:1787853615.938017:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787853615.938019:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992740030600, rc 0) 00000100:00100000:0.0:1787853615.938156:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276ae0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+11:10287:x1874700136376192:12345-192.168.206.10@tcp:101:bash.0 Request processed in 1181us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853615.938165:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:1.0:1787853615.944350:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853615.944535:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136376448 00000100:00100000:2.0:1787853615.944547:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136376448 00000100:00100000:2.0:1787853615.944620:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:2.0:1787853615.944632:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276ae0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+11:10287:x1874700136376448:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:2.0:1787853615.944660:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853615.944714:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054b82 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1fa6 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.944909:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71600/0xcf1365f7cb054b89 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.944926:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71600/0xcf1365f7cb054b89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.944939:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71600/0xcf1365f7cb054b89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.945827:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054b90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.945852:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054b90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.945865:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054b90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787853615.946439:0:7618:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787853615.946593:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054b97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.946603:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.946611:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.946644:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71600/0xcf1365f7cb054b89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.946651:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71600/0xcf1365f7cb054b89 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.946658:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71600/0xcf1365f7cb054b89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.946663:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853615.946668:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71600/0xcf1365f7cb054b89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.946726:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71600/0xcf1365f7cb054b89 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.946739:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:2.0:1787853615.946742:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853615.946745:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71600/0xcf1365f7cb054b89 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.946752:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71600/0xcf1365f7cb054b89 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787853615.946764:0:7618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce64267e reply state 00000000e8376e03 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054b90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853615.946773:0:7618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787853615.946806:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054b82 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fa6 expref: 14 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.946820:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054b97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fa6 expref: 13 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.946826:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992743be3300) 00010000:00010000:2.0:1787853615.946828:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853615.946831:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70000, rc 0) 00000100:00100000:2.0:1787853615.946907:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276ae0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:10287:x1874700136376448:12345-192.168.206.10@tcp:101:bash.0 Request processed in 2277us (2570us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787853615.946916:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:1.0:1787853615.952744:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853615.952897:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136376576 00000100:00100000:3.0:1787853615.952907:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136376576 00000100:00100000:3.0:1787853615.952954:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:3.0:1787853615.952962:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276ae0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1874700136376576:12345-192.168.206.10@tcp:8:bash.0 00010000:00080000:3.0:1787853615.952993:0:6672:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:3.0:1787853615.953023:0:6672:0:(genops.c:1385:class_connect()) connect: client 0d6ecd6d-a011-4e2a-a67c-6551aba162fe, cookie 0xcf1365f7cb054ba5 00002000:00100000:3.0:1787853615.953033:0:6672:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0d6ecd6d-a011-4e2a-a67c-6551aba162fe/ffff992747a31800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113953 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787853615.953054:0:6672:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787853615.953407:0:6672:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787853615.953435:0:6672:0:(import.c:65:import_set_state_nolock()) ffff992747a35800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787853615.953508:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276ae0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2361:x1874700136376576:12345-192.168.206.10@tcp:8:bash.0 Request processed in 544us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853615.953529:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 20 00010000:00010000:0.0:1787853615.954044:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054b90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.954056:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054b90 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.954063:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054b90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.954079:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71a00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853615.954084:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054b90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.954091:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054b90 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.954106:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff992743be3000) 00010000:00010000:0.0:1787853615.954110:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853615.954114:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054b90 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.954121:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054b90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853615.955638:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853615.958963:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136376704 00000100:00100000:2.0:1787853615.958989:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136376704 00000100:00100000:3.0:1787853615.959506:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:3.0:1787853615.959517:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276ae0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:0:x1874700136376704:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787853615.959533:0:11669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853615.959554:0:11669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006edf1f79/0xcf1365f7cb054bac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1fad expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787853615.959580:0:11669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853615.959608:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=310s v=(0 0) 00010000:00010000:3.0:1787853615.959614:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853615.959623:0:11669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006edf1f79/0xcf1365f7cb054bac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fad expref: 7 pid: 11669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853615.959652:0:11669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006edf1f79/0xcf1365f7cb054bac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fad expref: 7 pid: 11669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853615.959665:0:11669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064c200, rc 0) 00000100:00100000:3.0:1787853615.959771:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276ae0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:0:x1874700136376704:12345-192.168.206.10@tcp:101:bash.0 Request processed in 255us (4140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853615.959778:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00080000:0.0:1787853615.960898:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787853615.971040:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853615.971146:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136376832 00000100:00100000:3.0:1787853615.971154:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136376832 00000100:00100000:3.0:1787853615.971280:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:3.0:1787853615.971291:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274368a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:10287:x1874700136376832:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787853615.971308:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853615.971336:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084178858/0xcf1365f7cb054bb3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1fb4 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853615.971367:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006edf1f79/0xcf1365f7cb054bac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fad expref: 8 pid: 11669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853615.971375:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853615.971379:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853615.971384:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084178858/0xcf1365f7cb054bb3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fb4 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853615.971416:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006edf1f79/0xcf1365f7cb054bac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fad expref: 8 pid: 11669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853615.971429:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006edf1f79/0xcf1365f7cb054bac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fad expref: 8 pid: 11669 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853615.971442:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bf5e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6672:1874700152139136:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787853615.971533:0:6672:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927601d3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787853615.975556:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bf5e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6672:1874700152139136:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787853615.975598:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000084178858/0xcf1365f7cb054bb3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fb4 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853615.975619:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064c600, rc 0) 00000100:00100000:2.0:1787853615.975716:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274368a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:10287:x1874700136376832:12345-192.168.206.10@tcp:101:bash.0 Request processed in 4426us (4684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853615.975724:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:2.0:1787853615.978192:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853615.978359:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136376960 00000100:00100000:0.0:1787853615.978371:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136376960 00010000:00010000:0.0:1787853615.978432:0:8433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006edf1f79/0xcf1365f7cb054bac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fad expref: 8 pid: 11669 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853615.978580:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:0.0:1787853615.978593:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274368ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2364:x1874700136376960:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853615.978613:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853615.978642:0:8433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006edf1f79/0xcf1365f7cb054bac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fad expref: 8 pid: 11669 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.978659:0:8433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006edf1f79/0xcf1365f7cb054bac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fad expref: 8 pid: 11669 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.978743:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006edf1f79/0xcf1365f7cb054bac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fad expref: 8 pid: 11669 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.978766:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853615.978772:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853615.978782:0:8433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000084178858/0xcf1365f7cb054bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fb4 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853615.978868:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084178858/0xcf1365f7cb054bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fb4 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853615.979008:0:8433:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000084178858/0xcf1365f7cb054bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fb4 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853615.979031:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7b8f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8433:1874700152139264:192.168.206.10@tcp:105: 00000100:00100000:1.0:1787853615.979179:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d54e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787853615.986356:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7b8f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8433:1874700152139264:192.168.206.10@tcp:105: 00010000:00010000:1.0:1787853615.986918:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853615.987537:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274368ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2364:x1874700136376960:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 8939us (9351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853615.987553:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:3.0:1787853615.990747:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853615.990926:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136377216 00000100:00100000:1.0:1787853615.990939:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136377216 00000100:00100000:1.0:1787853615.991040:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:1.0:1787853615.991052:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+13:10287:x1874700136377216:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:1.0:1787853615.991772:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:10287:x1874700136377216:12345-192.168.206.10@tcp:35:bash.0 Request processed in 719us (1035us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787853615.991783:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00010000:00010000:3.0:1787853616.006704:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853616.077611:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853616.077845:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136377472 00000100:00100000:1.0:1787853616.077859:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136377472 00000100:00100000:1.0:1787853616.077931:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:1.0:1787853616.077942:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:10297:x1874700136377472:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787853616.077974:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853616.078003:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054bba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1fbb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853616.078154:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787853616.078316:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054bba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fbb expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.078334:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992743be3e00) 00010000:00010000:1.0:1787853616.078337:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787853616.078356:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054bba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fbb expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.078376:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766197600, rc 0) 00000100:00100000:1.0:1787853616.078471:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:10297:x1874700136377472:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 530us (876us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1787853616.078479:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:2.0:1787853616.082762:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853616.083083:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136377728 00000100:00100000:3.0:1787853616.083096:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136377728 00000100:00100000:3.0:1787853616.083170:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:3.0:1787853616.083191:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:10297:x1874700136377728:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787853616.083543:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+16:10297:x1874700136377728:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 363us (797us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787853616.083568:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:3.0:1787853616.193434:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853616.193598:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136377856 00000100:00100000:0.0:1787853616.193610:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136377856 00000100:00100000:0.0:1787853616.193731:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:0.0:1787853616.193745:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+16:10303:x1874700136377856:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787853616.193775:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853616.193813:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054bc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1fc2 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.193956:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054bcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.193973:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.194010:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853616.194086:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787853616.194091:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853616.194118:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.194151:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054bc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fc2 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.194173:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054bcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fc2 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.194183:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:0.0:1787853616.194186:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787853616.194191:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992740031800, rc 0) 00000100:00100000:0.0:1787853616.194284:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+17:10303:x1874700136377856:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 542us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853616.194292:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:0.0:1787853616.200892:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853616.201000:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136378112 00000100:00100000:1.0:1787853616.201024:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136378112 00000100:00100000:1.0:1787853616.201095:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:1.0:1787853616.201105:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+17:10303:x1874700136378112:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787853616.201124:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853616.201143:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054bd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1fc9 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.202072:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb054bdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.202091:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb054bdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.202103:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb054bdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853616.202115:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787853616.202814:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054bd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fc9 expref: 20 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.202836:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb054bdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fc9 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.202858:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992743be3300) 00010000:00010000:1.0:1787853616.202861:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787853616.202865:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766197400, rc 0) 00000100:00100000:1.0:1787853616.202935:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:10303:x1874700136378112:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1830us (2056us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787853616.202944:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:3.0:1787853616.207325:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853616.207393:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853616.207474:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136378496 00000100:00100000:1.0:1787853616.207487:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136378496 00000100:00100000:1.0:1787853616.207562:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:1.0:1787853616.207573:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:10303:x1874700136378496:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787853616.207598:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853616.207618:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb054beb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1fd0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.207760:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054bf2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.207776:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.207788:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853616.207800:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787853616.207916:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb054beb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fd0 expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.207957:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054bf2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fd0 expref: 21 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853616.207967:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136378240 00010000:00010000:1.0:1787853616.207968:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992743be3300) 00010000:00010000:1.0:1787853616.207977:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:0.0:1787853616.207980:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136378240 00010000:00010000:1.0:1787853616.207981:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766197200, rc 0) 00000100:00100000:0.0:1787853616.208063:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:1.0:1787853616.208074:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:10303:x1874700136378496:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 500us (678us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787853616.208083:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:2364:x1874700136378240:12345-192.168.206.10@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787853616.208094:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 44 00010000:00010000:0.0:1787853616.208104:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853616.208133:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb054bdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fc9 expref: 21 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.208170:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992743be3300) 00010000:00010000:0.0:1787853616.208176:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853616.220478:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+20:2364:x1874700136378240:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 12361us (13124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853616.220499:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:3.0:1787853616.225554:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853616.225639:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136378624 00000100:00100000:1.0:1787853616.225653:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136378624 00000100:00100000:1.0:1787853616.225767:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:1.0:1787853616.225782:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2364:x1874700136378624:12345-192.168.206.10@tcp:1:lfs.0 00010000:00010000:1.0:1787853616.225828:0:11669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb054c00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.225847:0:11669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000084178858/0xcf1365f7cb054bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fb4 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.225856:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853616.225861:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787853616.225866:0:11669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb054c00 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.225899:0:11669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000084178858/0xcf1365f7cb054bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fb4 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.225928:0:11669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000084178858/0xcf1365f7cb054bb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fb4 expref: 7 pid: 6672 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853616.225942:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7b8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11669:1874700152139392:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787853616.226048:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d54e240 going to sleep for 11 seconds 00000100:00100000:2.0:1787853616.239711:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853616.240519:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7b8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11669:1874700152139392:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787853616.240550:0:11669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb054c00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853616.241086:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136378752 00000100:00100000:3.0:1787853616.241095:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136378752 00002000:00100000:3.0:1787853616.241138:0:6676:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff99274368a1c0 x1874700136378752/t0(0) o4->0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp:37/0 lens 504/0 e 0 to 0 dl 1787853627 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787853616.241148:0:6676:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99274368a1c0 with x1874700136378752 ext(0->12) 00010000:00010000:3.0:1787853616.241155:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000084178858/0xcf1365f7cb054bb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fb4 expref: 8 pid: 6672 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853616.241169:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000084178858/0xcf1365f7cb054bb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fb4 expref: 8 pid: 6672 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787853616.241176:0:6676:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99274368a1c0 00000100:00100000:3.0:1787853616.241218:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:3.0:1787853616.241228:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274368a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2365:x1874700136378752:12345-192.168.206.10@tcp:4:lfs.0 00000001:00100000:2.0:1787853616.273163:0:7622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0d6ecd6d-a011-4e2a-a67c-6551aba162fe 00000100:00100000:1.0:1787853616.273926:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274368a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:2365:x1874700136378752:12345-192.168.206.10@tcp:4:lfs.0 Request processed in 32695us (34258us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787853616.273943:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00002000:00100000:1.0:1787853616.273954:0:6676:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff99274368a1c0 x1874700136378752/t4294967299(0) o4->0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp:37/0 lens 504/448 e 0 to 0 dl 1787853627 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787853616.273964:0:6676:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99274368a1c0 with x1874700136378752 ext(0->12) 00010000:00010000:1.0:1787853616.273973:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000084178858/0xcf1365f7cb054bb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fb4 expref: 9 pid: 6672 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.273992:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000084178858/0xcf1365f7cb054bb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fb4 expref: 9 pid: 6672 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787853616.273999:0:6676:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99274368a1c0 00000100:00100000:0.0:1787853616.276778:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853616.276914:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136378880 00000100:00100000:3.0:1787853616.276924:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136378880 00010000:00010000:3.0:1787853616.276961:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000084178858/0xcf1365f7cb054bb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fb4 expref: 9 pid: 6672 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853616.277004:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:3.0:1787853616.277015:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:2364:x1874700136378880:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853616.277042:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787853616.277060:0:5811:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787853616.277063:0:5811:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787853615 00002000:00010000:3.0:1787853616.277065:0:5811:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787853616 00002000:00010000:3.0:1787853616.277068:0:5811:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787853615 00010000:00010000:3.0:1787853616.277073:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000084178858/0xcf1365f7cb054bb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fb4 expref: 9 pid: 6672 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853616.277087:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000084178858/0xcf1365f7cb054bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fb4 expref: 9 pid: 6672 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853616.277109:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084178858/0xcf1365f7cb054bb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fb4 expref: 9 pid: 6672 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853616.277124:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853616.277129:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853616.277134:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb054c00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853616.277144:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb054c00 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853616.277180:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853616.277248:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2364:x1874700136378880:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 234us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853616.277256:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 36 00010000:00010000:1.0:1787853616.277954:0:11669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb054c00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.277973:0:11669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb054c00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.277999:0:11669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb054c00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.278007:0:11669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb054c00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.278015:0:11669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb054c00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.278023:0:11669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197600 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:1.0:1787853616.278027:0:11669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb054c00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.278035:0:11669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb054c00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.278051:0:11669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb054c00 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.278059:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb054c00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853616.278135:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2364:x1874700136378624:12345-192.168.206.10@tcp:1:lfs.0 Request processed in 52358us (52594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853616.278144:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:0.0:1787853616.283960:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853616.284048:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136379136 00000100:00100000:3.0:1787853616.284057:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136379136 00000100:00100000:3.0:1787853616.284110:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:3.0:1787853616.284120:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+20:10303:x1874700136379136:12345-192.168.206.10@tcp:35:lfs.0 00000004:00010000:3.0:1787853616.284176:0:5828:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054bf2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fd0 expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787853616.285305:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1787853616.285461:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1787853616.291069:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1787853616.291397:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054c07 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853616.291416:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054b97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fa6 expref: 24 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853616.291426:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054c07 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853616.291465:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054b97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fa6 expref: 24 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853616.291481:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054b97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fa6 expref: 24 pid: 7618 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853616.291495:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bf5f840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5828:1874700152139520:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787853616.295700:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff99275169b900 going to sleep for 11 seconds 00000100:00100000:2.0:1787853616.300477:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853616.300592:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bf5f840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5828:1874700152139520:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787853616.300600:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136379264 00000100:00100000:0.0:1787853616.300608:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136379264 00010000:00010000:3.0:1787853616.300636:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054c07 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.300649:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054b97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fa6 expref: 25 pid: 7618 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853616.300700:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:3.0:1787853616.300711:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761eaa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+25:2365:x1874700136379264:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853616.300725:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853616.300732:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054b97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fa6 expref: 25 pid: 7618 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853616.300751:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054b97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fa6 expref: 25 pid: 7618 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853616.300771:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054b97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fa6 expref: 25 pid: 7618 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853616.300785:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992743be3300) 00010000:00010000:3.0:1787853616.300790:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054c07 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853616.300798:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054c07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853616.300806:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054c07 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853616.300835:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853616.300895:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761eaa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+24:2365:x1874700136379264:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 187us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853616.300902:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 37 00010000:00010000:0.0:1787853616.301769:0:5828:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054c07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.301780:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054c07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787853616.301901:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1787853616.302130:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1787853616.302880:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dc9f840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5828:1874700152139648:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787853616.303321:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853616.305077:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927660f93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853616.306943:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152139648 00000100:00100000:2.0:1787853616.307034:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152139648 00000100:00100000:2.0:1787853616.307158:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787853616.307170:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5828:x1874700152139648:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787853616.307307:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5828:x1874700152139648:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 140us (4217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853616.307314:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787853616.307709:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dc9f840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5828:1874700152139648:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787853616.308536:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1787853616.308611:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7b8f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5828:1874700152139776:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787853616.308658:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853616.308712:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff992752c4ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853616.309151:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152139776 00000100:00100000:0.0:1787853616.309157:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152139776 00000100:00100000:0.0:1787853616.309205:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787853616.309214:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5828:x1874700152139776:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787853616.309401:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5828:x1874700152139776:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 188us (741us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787853616.309409:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787853616.309831:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7b8f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5828:1874700152139776:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787853616.309894:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1787853616.309933:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054c07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.309943:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054c07 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.309950:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054c07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.309967:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064c600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853616.309971:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054c07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.309978:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054c07 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.309994:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992743be3300) 00010000:00010000:1.0:1787853616.310005:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787853616.310010:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054c07 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.310016:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054c07 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787853616.310524:0:5828:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787853616.310770:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1787853616.310781:0:5828:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 310608107193ns, next at 311608104960ns, rc = 0 00000001:00080000:1.0:1787853616.310788:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1787853616.310818:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992743be3300) 00010000:00010000:1.0:1787853616.310821:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787853616.310828:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054bf2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fd0 expref: 28 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853616.310926:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+27:10303:x1874700136379136:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 26806us (26973us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787853616.310934:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00000020:00080000:1.0:1787853616.310939:0:5828:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787853616.313040:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853616.313762:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136379392 00000100:00100000:1.0:1787853616.313772:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136379392 00000100:00100000:1.0:1787853616.313837:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:1.0:1787853616.313847:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+27:10303:x1874700136379392:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787853616.313867:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853616.313889:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb054c0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1fd7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.313945:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb054c0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fd7 expref: 28 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.313973:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb054c0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fd7 expref: 28 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.313991:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:1.0:1787853616.313994:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787853616.313998:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196600, rc 0) 00000100:00100000:1.0:1787853616.314051:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+28:10303:x1874700136379392:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 205us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853616.314058:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00080000:3.0:1787853616.316549:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853616.318857:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853616.318941:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136379648 00000100:00100000:1.0:1787853616.318951:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136379648 00000100:00100000:1.0:1787853616.319006:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:1.0:1787853616.319016:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274f749450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+28:10303:x1874700136379648:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:1.0:1787853616.319465:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274f749450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+29:10303:x1874700136379648:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 449us (615us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787853616.319473:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:1.0:1787853616.429864:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853616.429984:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136379904 00000100:00100000:0.0:1787853616.429994:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136379904 00000100:00100000:0.0:1787853616.430058:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:0.0:1787853616.430067:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+29:10313:x1874700136379904:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787853616.430088:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853616.430106:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054c15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1fde expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853616.430234:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787853616.430330:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054c15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fde expref: 31 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.430344:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992743be3e00) 00010000:00010000:0.0:1787853616.430347:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787853616.430352:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054c15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fde expref: 31 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.430367:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992740030400, rc 0) 00000100:00100000:0.0:1787853616.430938:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+30:10313:x1874700136379904:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 862us (1072us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1787853616.430946:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:1.0:1787853616.437990:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853616.438092:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136380032 00000100:00100000:0.0:1787853616.438125:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136380032 00000100:00100000:0.0:1787853616.438204:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:0.0:1787853616.438215:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+30:10313:x1874700136380032:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:0.0:1787853616.438329:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054c23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438349:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054c23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438363:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054c23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438380:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054c2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438387:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438396:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438524:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438533:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438539:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787853616.438588:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438613:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054c23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438619:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054c23 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438627:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054c23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438633:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740030400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853616.438638:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054c23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438645:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054c23 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438659:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:0.0:1787853616.438662:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853616.438667:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054c23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438714:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054c23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438729:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438735:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054c2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438740:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054c2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438750:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853616.438753:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054c2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438758:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054c2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438766:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff992761dc9c00) 00010000:00010000:0.0:1787853616.438769:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853616.438771:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054c2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438777:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054c2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438791:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438796:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438802:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438806:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927429f6800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853616.438808:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438813:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438828:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:0.0:1787853616.438830:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853616.438833:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.438838:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853616.438933:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+30:10313:x1874700136380032:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 718us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853616.438942:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:2.0:1787853616.448217:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853616.448393:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136380288 00000100:00100000:0.0:1787853616.448406:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136380288 00000100:00100000:0.0:1787853616.448475:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:0.0:1787853616.448486:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+30:10313:x1874700136380288:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:0.0:1787853616.448862:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+31:10313:x1874700136380288:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 376us (669us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1787853616.448871:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:2.0:1787853616.490290:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853616.490475:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136380544 00000100:00100000:1.0:1787853616.490487:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136380544 00000100:00100000:1.0:1787853616.490567:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:1.0:1787853616.490578:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+31:10316:x1874700136380544:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787853616.490610:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853616.490637:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054c38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1fe5 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.490977:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c3f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.490996:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.491008:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.491025:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb054c46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.491031:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb054c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.491037:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb054c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.491942:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb054c4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.491961:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb054c4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.491971:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb054c4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853616.491986:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787853616.492128:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.492136:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c3f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.492159:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.492166:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853616.492171:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.492180:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c3f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.492206:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:1.0:1787853616.492210:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853616.492215:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.492222:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.492239:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb054c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.492246:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb054c46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.492252:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb054c46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.492257:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853616.492259:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb054c46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.492275:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb054c46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.492285:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9927433f1600) 00010000:00010000:1.0:1787853616.492287:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853616.492290:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb054c46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.492297:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb054c46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.492358:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054c38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fe5 expref: 34 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.492375:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb054c4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fe5 expref: 33 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.492382:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:1.0:1787853616.492385:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787853616.492387:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196c00, rc 0) 00000100:00100000:1.0:1787853616.493862:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+33:10316:x1874700136380544:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 3272us (3574us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1787853616.493876:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:2.0:1787853616.496552:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853616.496649:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136380672 00000100:00100000:0.0:1787853616.496661:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136380672 00000100:00100000:0.0:1787853616.496958:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:0.0:1787853616.496971:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775480b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+33:10316:x1874700136380672:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:0.0:1787853616.497062:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.497084:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.497122:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.497157:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.497164:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.497172:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.497179:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927429f6800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853616.497184:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.497209:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.497225:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:0.0:1787853616.497228:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787853616.497234:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.497241:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853616.497388:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775480b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+33:10316:x1874700136380672:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 420us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853616.497398:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:2.0:1787853616.514502:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853616.514657:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136380928 00000100:00100000:0.0:1787853616.514724:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136380928 00000100:00100000:0.0:1787853616.514784:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:0.0:1787853616.514796:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775483c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+33:10316:x1874700136380928:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:0.0:1787853616.515110:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775483c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+34:10316:x1874700136380928:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 316us (623us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787853616.515120:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:2.0:1787853616.580041:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853616.580113:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853616.580155:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136381056 00000100:00100000:0.0:1787853616.580171:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136381056 00000100:00100000:0.0:1787853616.580266:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 283 00000100:00100000:0.0:1787853616.580277:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927501ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2362:x1874700136381056:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853616.580386:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927501ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2362:x1874700136381056:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 110us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853616.580395:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 283 00000100:00100000:1.0:1787853616.580817:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136381184 00000100:00100000:1.0:1787853616.580825:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136381184 00000100:00100000:1.0:1787853616.580900:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 125 00000100:00100000:1.0:1787853616.580909:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775482d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2362:x1874700136381184:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853616.581002:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775482d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2362:x1874700136381184:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 94us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853616.581396:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 125 00000100:00080000:2.0:1787853616.582329:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853616.882358:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853616.882494:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136381440 00000100:00100000:1.0:1787853616.882513:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136381440 00000100:00100000:1.0:1787853616.882592:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:1.0:1787853616.882604:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775483840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+34:10347:x1874700136381440:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:1.0:1787853616.882638:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853616.882664:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054c62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1fec expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.882829:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb054c69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.882848:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb054c69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.882864:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb054c69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853616.882876:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787853616.883057:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054c62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fec expref: 37 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.883080:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb054c69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fec expref: 36 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.883090:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:1.0:1787853616.883125:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787853616.883130:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196800, rc 0) 00000100:00100000:1.0:1787853616.883218:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775483840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+36:10347:x1874700136381440:12345-192.168.206.10@tcp:101:cat.0 Request processed in 615us (874us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1787853616.883226:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:0.0:1787853616.888056:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853616.888921:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136381568 00000100:00100000:3.0:1787853616.888936:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136381568 00000100:00100000:3.0:1787853616.889029:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:3.0:1787853616.889041:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274415d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+36:2364:x1874700136381568:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853616.889062:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853616.889097:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb054c69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fec expref: 36 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853616.889275:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:3.0:1787853616.889284:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853616.889937:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274415d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+35:2364:x1874700136381568:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 895us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853616.889949:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:3.0:1787853616.890447:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853616.891033:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136381824 00000100:00100000:0.0:1787853616.891044:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136381824 00000100:00100000:0.0:1787853616.891203:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:0.0:1787853616.891215:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+35:10347:x1874700136381824:12345-192.168.206.10@tcp:35:cat.0 00000100:00100000:0.0:1787853616.893851:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+36:10347:x1874700136381824:12345-192.168.206.10@tcp:35:cat.0 Request processed in 2621us (3388us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787853616.893870:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:1.0:1787853616.966202:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927754830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152139904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853616.966303:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853616.966492:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152139904 00000100:00100000:2.0:1787853616.966503:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152139904 00000100:00100000:2.0:1787853616.966595:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1787853616.966704:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853616.966753:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152139904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853616.966800:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853616.966975:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152139904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 370us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853616.966984:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787853616.968779:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927754830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152139904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853616.972358:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853616.972531:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136382080 00000100:00100000:1.0:1787853616.972544:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136382080 00000100:00100000:1.0:1787853616.972624:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:1.0:1787853616.972636:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+36:10353:x1874700136382080:12345-192.168.206.10@tcp:101:dd.0 00010000:00010000:1.0:1787853616.972668:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853616.972704:0:7618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787853616.972967:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054bcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fc2 expref: 36 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.972996:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:1.0:1787853616.973002:0:7618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853616.973020:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054c77 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1ff3 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.973232:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.973248:0:7618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb054c4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fe5 expref: 36 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.973277:0:7618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c7e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.973320:0:7618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb054c4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fe5 expref: 36 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.973335:0:7618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb054c4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fe5 expref: 36 pid: 7618 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853616.973352:0:7618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7b8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7618:1874700152140032:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787853616.973732:0:7618:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d54e840 going to sleep for 11 seconds 00000100:00100000:3.0:1787853616.984292:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853616.985103:0:7618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7b8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7618:1874700152140032:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787853616.985217:0:7618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853616.985306:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136382208 00000100:00100000:0.0:1787853616.985316:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136382208 00010000:00010000:0.0:1787853616.985366:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb054c4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fe5 expref: 37 pid: 7618 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853616.985549:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:0.0:1787853616.985561:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+37:2365:x1874700136382208:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853616.985581:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853616.985589:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb054c4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fe5 expref: 37 pid: 7618 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.985603:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb054c4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fe5 expref: 37 pid: 7618 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.985629:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb054c4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fe5 expref: 37 pid: 7618 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.985649:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:0.0:1787853616.985656:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.985667:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.985944:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c7e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.985974:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853616.986056:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+36:2365:x1874700136382208:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 497us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853616.986066:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 38 00010000:00010000:1.0:1787853616.986132:0:7618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.986140:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853616.986164:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787853616.986605:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054c77 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ff3 expref: 37 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.986625:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ff3 expref: 36 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853616.986654:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:1.0:1787853616.986658:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787853616.986661:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766197000, rc 0) 00000100:00100000:1.0:1787853616.986738:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+36:10353:x1874700136382080:12345-192.168.206.10@tcp:101:dd.0 Request processed in 14104us (14394us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1787853616.986750:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:3.0:1787853616.991922:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853616.992252:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136382464 00000100:00100000:0.0:1787853616.992283:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136382464 00000100:00100000:0.0:1787853616.992427:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:0.0:1787853616.992440:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+36:10353:x1874700136382464:12345-192.168.206.10@tcp:36:dd.0 00010000:00010000:0.0:1787853616.993002:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.993025:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853616.993039:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787853616.993102:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1787853616.993347:0:5825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003a81b0b reply state 00000000ac78553c transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853616.993358:0:5825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787853616.993647:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+39:10353:x1874700136382464:12345-192.168.206.10@tcp:36:dd.0 Request processed in 1207us (1737us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1787853616.993656:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 52 00000020:00080000:0.0:1787853616.993662:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787853617.005285:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.005309:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.005317:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.005322:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927429f6800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853617.005328:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.005355:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c8c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.005377:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:0.0:1787853617.005380:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853617.005386:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c8c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.005394:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c8c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.030756:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853617.348830:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853617.349091:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136382592 00000100:00100000:0.0:1787853617.349104:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136382592 00000100:00100000:0.0:1787853617.349212:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:0.0:1787853617.349224:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+38:10367:x1874700136382592:12345-192.168.206.10@tcp:101:stat.0 00010000:00010000:0.0:1787853617.349257:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853617.349284:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd1ffa expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.349368:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f7000/0xcf1365f7cb054c9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.349398:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f7000/0xcf1365f7cb054c9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.349412:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f7000/0xcf1365f7cb054c9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.349429:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054ca1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.349452:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.349460:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.349585:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054ca8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.349596:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c7e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ff3 expref: 39 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.349605:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054ca8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.349646:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ff3 expref: 39 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.349663:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ff3 expref: 39 pid: 7618 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853617.349721:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dc9de00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5824:1874700152140160:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787853617.349845:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927660f90c0 going to sleep for 11 seconds 00000100:00080000:1.0:1787853617.350172:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853617.354979:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dc9de00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5824:1874700152140160:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787853617.355026:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054ca8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853617.369060:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853617.369310:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136382848 00000100:00100000:1.0:1787853617.369323:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136382848 00000100:00100000:1.0:1787853617.369393:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:1.0:1787853617.369404:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+40:5600:x1874700136382848:12345-192.168.206.10@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787853617.370044:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+41:5600:x1874700136382848:12345-192.168.206.10@tcp:35:ldlm_bl.0 Request processed in 497us (1006us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787853617.370058:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:2.0:1787853617.376658:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853617.376801:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136382976 00000100:00100000:3.0:1787853617.376813:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136382976 00010000:00010000:3.0:1787853617.376863:0:8433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ff3 expref: 41 pid: 7618 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853617.377006:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:3.0:1787853617.377018:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775481a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+41:2363:x1874700136382976:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853617.377058:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853617.377066:0:8433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ff3 expref: 41 pid: 7618 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.377081:0:8433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ff3 expref: 41 pid: 7618 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.377110:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054c7e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ff3 expref: 41 pid: 7618 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.377142:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:3.0:1787853617.377149:0:8433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054ca8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.377159:0:8433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.377167:0:8433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054ca8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.377220:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853617.377297:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775481a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+40:2363:x1874700136382976:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 280us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853617.377306:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 39 00010000:00010000:1.0:1787853617.377382:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.377392:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853617.377449:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787853617.377455:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853617.377509:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.377524:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.377548:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f7000/0xcf1365f7cb054c9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.377554:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f7000/0xcf1365f7cb054c9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.377561:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f7000/0xcf1365f7cb054c9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.377568:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927429f7000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853617.377573:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f7000/0xcf1365f7cb054c9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.377581:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f7000/0xcf1365f7cb054c9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.377593:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:1.0:1787853617.377595:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853617.377599:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f7000/0xcf1365f7cb054c9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.377605:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f7000/0xcf1365f7cb054c9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.377619:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.377625:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054ca1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.377631:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.377643:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853617.377646:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.377652:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054ca1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.377661:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff992761dc9c00) 00010000:00010000:1.0:1787853617.377663:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853617.377666:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054ca1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.377719:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054ca1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.377766:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927429f6800/0xcf1365f7cb054c93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ffa expref: 40 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.377783:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ffa expref: 39 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.377791:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:1.0:1787853617.377793:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787853617.377795:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992740031000, rc 0) 00000100:00100000:1.0:1787853617.377830:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+39:10367:x1874700136382592:12345-192.168.206.10@tcp:101:stat.0 Request processed in 28609us (29015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853617.377838:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:2.0:1787853617.468872:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853617.469000:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136383232 00000100:00100000:1.0:1787853617.469045:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136383232 00000100:00100000:1.0:1787853617.469130:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 54 00000100:00100000:1.0:1787853617.469142:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927754830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+39:10373:x1874700136383232:12345-192.168.206.10@tcp:36:truncate.0 00010000:00010000:1.0:1787853617.469236:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853617.469272:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054ca8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ffa expref: 39 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.469296:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:1.0:1787853617.469302:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853617.470200:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054caf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.470220:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054caf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.470233:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054caf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787853617.470339:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1787853617.470374:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a0f6ad9 reply state 00000000e4feaf0c transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054caf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853617.470383:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787853617.470651:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927754830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+41:10373:x1874700136383232:12345-192.168.206.10@tcp:36:truncate.0 Request processed in 1509us (1801us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1787853617.470661:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 54 00000020:00080000:1.0:1787853617.470668:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787853617.475694:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054caf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.475736:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054caf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.475745:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054caf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.475752:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853617.475757:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054caf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.475766:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054caf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.475787:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:0.0:1787853617.475790:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853617.475795:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054caf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.475802:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054caf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853617.645222:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853617.645391:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136383360 00000100:00100000:3.0:1787853617.645405:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136383360 00000100:00100000:3.0:1787853617.645488:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 55 00000100:00100000:3.0:1787853617.645499:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+40:10387:x1874700136383360:12345-192.168.206.10@tcp:101:stat.0 00010000:00010000:3.0:1787853617.645541:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853617.645566:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054cb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2001 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.645633:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054cbd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.645652:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054cbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.645664:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054cbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.645725:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054cc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.645735:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.645742:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.645839:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ccb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.645847:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.645854:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853617.645905:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1787853617.645916:0:7618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853617.645943:0:7618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.647557:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.647574:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054cbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.647582:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054cbd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.647588:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054cbd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.647594:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064cc00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853617.647598:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054cbd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.647605:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054cbd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.647620:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:3.0:1787853617.647624:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853617.647629:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054cbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.647635:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054cbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.647651:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.647792:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054cc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.647799:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.647804:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853617.647807:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.647813:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054cc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.647822:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff992742cdd800) 00010000:00010000:3.0:1787853617.647825:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853617.647828:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054cc4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.647834:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054cc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.647888:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054cb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2001 expref: 42 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.647903:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ccb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2001 expref: 41 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.647911:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:3.0:1787853617.647913:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853617.647922:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064dc00, rc 0) 00000100:00100000:3.0:1787853617.648002:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+41:10387:x1874700136383360:12345-192.168.206.10@tcp:101:stat.0 Request processed in 2503us (2792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853617.648011:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 55 00000100:00100000:2.0:1787853617.751561:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853617.751652:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136383616 00000100:00100000:0.0:1787853617.751661:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136383616 00000100:00100000:0.0:1787853617.751741:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 56 00000100:00100000:0.0:1787853617.751762:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+41:10397:x1874700136383616:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787853617.751793:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853617.751813:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054cd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2008 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853617.751925:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787853617.752052:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054cd2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2008 expref: 43 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.752080:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992743be3e00) 00010000:00010000:0.0:1787853617.752083:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787853617.752088:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054cd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2008 expref: 43 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.752103:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992740030400, rc 0) 00000100:00100000:0.0:1787853617.752166:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+42:10397:x1874700136383616:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 406us (624us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1787853617.752173:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 56 00000100:00100000:2.0:1787853617.759767:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853617.759981:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136383872 00000100:00100000:1.0:1787853617.759992:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136383872 00000100:00100000:1.0:1787853617.760049:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:1.0:1787853617.761224:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+42:10397:x1874700136383872:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:1.0:1787853617.762011:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+43:10397:x1874700136383872:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 822us (2252us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1787853617.762021:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:2.0:1787853617.895094:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853617.895212:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136384128 00000100:00100000:1.0:1787853617.895221:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136384128 00000100:00100000:1.0:1787853617.895296:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:1.0:1787853617.895307:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+43:10403:x1874700136384128:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:1.0:1787853617.895332:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853617.895351:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb054ce0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd200f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.895448:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb054ce7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.895462:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ccb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2001 expref: 44 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.895472:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb054ce7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.895504:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ccb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2001 expref: 44 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.895518:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ccb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2001 expref: 44 pid: 7618 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853617.895531:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7b8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5824:1874700152140288:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787853617.895651:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d1de840 going to sleep for 11 seconds 00000100:00100000:1.0:1787853617.898566:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7b8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5824:1874700152140288:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787853617.898597:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb054ce7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853617.901215:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853617.901314:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136384256 00000100:00100000:3.0:1787853617.901324:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136384256 00010000:00010000:3.0:1787853617.901365:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ccb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2001 expref: 45 pid: 7618 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853617.901408:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:3.0:1787853617.901419:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+45:2364:x1874700136384256:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853617.901433:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853617.901440:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ccb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2001 expref: 45 pid: 7618 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.901454:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ccb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2001 expref: 45 pid: 7618 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.901479:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ccb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2001 expref: 45 pid: 7618 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.901495:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:3.0:1787853617.901501:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb054ce7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.901510:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb054ce7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.901517:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb054ce7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.901565:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853617.901625:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+44:2364:x1874700136384256:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 207us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853617.901633:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 40 00010000:00010000:1.0:1787853617.901927:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb054ce7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.901936:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb054ce7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853617.901953:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1787853617.902102:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb054ce0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd200f expref: 45 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.902118:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb054ce7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd200f expref: 44 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853617.902125:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:1.0:1787853617.902127:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787853617.902130:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196400, rc 0) 00000100:00100000:1.0:1787853617.902158:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+44:10403:x1874700136384128:12345-192.168.206.10@tcp:101:bash.0 Request processed in 6854us (7081us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1787853617.902165:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:2.0:1787853617.907762:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853617.907880:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136384512 00000100:00100000:0.0:1787853617.907889:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136384512 00000100:00100000:0.0:1787853617.907944:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 58 00000100:00100000:0.0:1787853617.907954:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+44:10403:x1874700136384512:12345-192.168.206.10@tcp:36:bash.0 00010000:00010000:0.0:1787853617.908214:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054cf5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.908235:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054cf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.908246:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054cf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787853617.908301:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1787853617.908327:0:5825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ffe41d2 reply state 000000003e4d487f transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054cf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853617.908335:0:5825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787853617.908436:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+47:10403:x1874700136384512:12345-192.168.206.10@tcp:36:bash.0 Request processed in 483us (683us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787853617.908444:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 58 00000020:00080000:0.0:1787853617.908448:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787853617.921563:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054cf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.921580:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054cf5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.921589:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054cf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.921595:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740030400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853617.921599:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054cf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.921606:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054cf5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.921622:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:0.0:1787853617.921625:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853617.921629:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054cf5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.921635:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054cf5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853617.921862:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853617.922036:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136384640 00000100:00100000:3.0:1787853617.922045:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136384640 00000100:00100000:3.0:1787853617.922098:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 59 00000100:00100000:3.0:1787853617.922108:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+46:10403:x1874700136384640:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787853617.922130:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853617.922146:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054cfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2016 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.922232:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054d03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.922244:0:7618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb054ce7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd200f expref: 47 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.922252:0:7618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054d03 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.922293:0:7618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb054ce7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd200f expref: 47 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.922307:0:7618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb054ce7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd200f expref: 47 pid: 5824 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853617.922320:0:7618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7618:1874700152140416:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787853617.922414:0:7618:0:(client.c:2715:ptlrpc_set_wait()) set ffff99275169b780 going to sleep for 11 seconds 00000100:00100000:2.0:1787853617.928128:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853617.928212:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136384768 00000100:00100000:0.0:1787853617.928221:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136384768 00010000:00010000:0.0:1787853617.928257:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb054ce7 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd200f expref: 48 pid: 5824 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853617.928315:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:0.0:1787853617.928325:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e68780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+48:2365:x1874700136384768:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853617.928341:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853617.928348:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb054ce7 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd200f expref: 48 pid: 5824 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.928362:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb054ce7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd200f expref: 48 pid: 5824 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.928385:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:0.0:1787853617.928390:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054d03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.928410:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.928419:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054d03 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853617.928437:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853617.928492:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e68780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+48:2365:x1874700136384768:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 168us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853617.928499:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 41 00010000:00010000:3.0:1787853617.928991:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb054ce7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd200f expref: 47 pid: 5824 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853617.929008:0:7618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a52c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7618:1874700152140416:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787853617.929042:0:7618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.929052:0:7618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.929058:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853617.929101:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787853617.929105:0:7618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853617.929126:0:7618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.929154:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054cfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2016 expref: 47 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.929168:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054d03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2016 expref: 46 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853617.929176:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:3.0:1787853617.929179:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853617.929181:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064c200, rc 0) 00000100:00100000:3.0:1787853617.929235:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+46:10403:x1874700136384640:12345-192.168.206.10@tcp:101:bash.0 Request processed in 7129us (7376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853617.929252:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 59 00000100:00100000:2.0:1787853617.939218:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853617.939295:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136385024 00000100:00100000:0.0:1787853617.939304:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136385024 00000100:00100000:0.0:1787853617.939367:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:0.0:1787853617.939377:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274f707050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+46:10403:x1874700136385024:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:0.0:1787853617.939619:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274f707050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+47:10403:x1874700136385024:12345-192.168.206.10@tcp:35:bash.0 Request processed in 242us (407us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1787853617.939628:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:2.0:1787853618.053359:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853618.053486:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136385280 00000100:00100000:1.0:1787853618.053496:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136385280 00000100:00100000:1.0:1787853618.053558:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:1.0:1787853618.053567:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+47:10413:x1874700136385280:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787853618.053605:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853618.053624:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb054d0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd201d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.054057:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:1.0:1787853618.054299:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787853618.054417:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb054d0a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd201d expref: 49 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853618.054432:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992743be3e00) 00010000:00010000:1.0:1787853618.054435:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787853618.054440:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb054d0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd201d expref: 49 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853618.054454:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766197a00, rc 0) 00000100:00100000:1.0:1787853618.054514:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+48:10413:x1874700136385280:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 948us (1175us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1787853618.054522:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:1.0:1787853618.061079:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853618.063063:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136385408 00000100:00100000:0.0:1787853618.063079:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136385408 00000100:00100000:0.0:1787853618.063240:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:0.0:1787853618.063252:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+48:10413:x1874700136385408:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:0.0:1787853618.063327:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054d18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063354:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054d18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063366:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054d18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063383:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054d1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063392:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063399:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063500:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054d26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063508:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063533:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787853618.063575:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063587:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054d18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063593:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054d18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063600:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054d18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063606:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740030400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853618.063610:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054d18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063618:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054d18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063630:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:0.0:1787853618.063633:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853618.063637:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054d18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063644:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054d18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063658:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063670:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054d1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063711:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054d1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063717:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853618.063720:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054d1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063726:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054d1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063735:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff992761dc9800) 00010000:00010000:0.0:1787853618.063737:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853618.063740:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054d1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063745:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054d1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063760:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063766:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054d26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063772:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054d26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063778:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853618.063787:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054d26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063793:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054d26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063801:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:0.0:1787853618.063804:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853618.063807:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054d26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.063812:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054d26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853618.063893:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+48:10413:x1874700136385408:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 643us (2823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853618.063901:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:2.0:1787853618.070860:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853618.071122:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136385664 00000100:00100000:1.0:1787853618.071130:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136385664 00000100:00100000:1.0:1787853618.071285:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:1.0:1787853618.071295:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+48:10413:x1874700136385664:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:1.0:1787853618.071568:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+49:10413:x1874700136385664:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 274us (717us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787853618.071577:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:2.0:1787853618.161222:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853618.161340:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136385920 00000100:00100000:0.0:1787853618.161353:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136385920 00000100:00100000:0.0:1787853618.161428:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00100000:0.0:1787853618.161440:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+49:10416:x1874700136385920:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787853618.161470:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853618.161496:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054d2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2024 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.161607:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054d34 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.161625:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054d34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.161659:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054d34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.161719:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054d3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.161728:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054d3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.161734:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054d3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.161891:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb054d42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.161900:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb054d42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.161907:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb054d42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853618.161919:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787853618.162033:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054d34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.162041:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054d34 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.162048:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054d34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.162055:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853618.162066:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054d34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.162074:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054d34 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.162087:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:0.0:1787853618.162091:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853618.162096:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054d34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.162103:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054d34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.162121:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054d3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.162128:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054d3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.162134:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054d3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.162140:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740030400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853618.162143:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054d3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.162149:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054d3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.162157:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff992761dc9800) 00010000:00010000:0.0:1787853618.162159:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853618.162170:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054d3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.162177:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054d3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.162240:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054d2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2024 expref: 52 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.162255:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb054d42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2024 expref: 51 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.162261:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:0.0:1787853618.162264:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853618.162266:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927821c7800, rc 0) 00000100:00100000:0.0:1787853618.162340:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+51:10416:x1874700136385920:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 902us (1132us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787853618.162349:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00100000:2.0:1787853618.168536:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853618.168667:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136386048 00000100:00100000:3.0:1787853618.168827:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136386048 00000100:00100000:2.0:1787853618.169018:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00100000:2.0:1787853618.169030:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+51:10416:x1874700136386048:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:2.0:1787853618.169134:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054d50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853618.169156:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853618.169170:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853618.169265:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853618.169274:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054d50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853618.169281:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054d50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853618.169288:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71a00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853618.169354:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054d50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853618.169364:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054d50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853618.169379:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:2.0:1787853618.169383:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787853618.169388:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054d50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853618.170136:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054d50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853618.170278:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+51:10416:x1874700136386048:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 1246us (1752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853618.170289:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00100000:2.0:1787853618.174893:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853618.175790:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136386176 00000100:00100000:3.0:1787853618.175805:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136386176 00000100:00100000:3.0:1787853618.175905:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:3.0:1787853618.175917:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+51:2364:x1874700136386176:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853618.175941:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853618.175977:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb054d42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2024 expref: 51 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.176004:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:3.0:1787853618.176010:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853618.176080:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+50:2364:x1874700136386176:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 165us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853618.176089:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:1.0:1787853618.181130:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853618.182382:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136386432 00000100:00100000:0.0:1787853618.182400:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136386432 00000100:00100000:0.0:1787853618.182535:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:0.0:1787853618.182547:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+50:10416:x1874700136386432:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:0.0:1787853618.183527:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+51:10416:x1874700136386432:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 963us (2391us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1787853618.183540:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:0.0:1787853618.385939:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853618.386150:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136386688 00000100:00100000:1.0:1787853618.386163:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136386688 00000100:00100000:1.0:1787853618.386257:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 64 00000100:00100000:1.0:1787853618.386268:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+51:10434:x1874700136386688:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:1.0:1787853618.386299:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853618.386325:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb054d57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd202b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853618.386482:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196a00/0xcf1365f7cb054d5e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853618.386500:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196a00/0xcf1365f7cb054d5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853618.386525:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196a00/0xcf1365f7cb054d5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853618.386540:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787853618.386737:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb054d57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd202b expref: 54 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853618.386762:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196a00/0xcf1365f7cb054d5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd202b expref: 53 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853618.386773:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:1.0:1787853618.386776:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787853618.386780:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196a00, rc 0) 00000100:00100000:1.0:1787853618.386861:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+53:10434:x1874700136386688:12345-192.168.206.10@tcp:101:cat.0 Request processed in 595us (937us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1787853618.386881:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 64 00000100:00100000:2.0:1787853618.440003:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853618.440773:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136386816 00000100:00100000:0.0:1787853618.440787:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136386816 00000100:00100000:2.0:1787853618.440921:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:2.0:1787853618.440938:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+53:10435:x1874700136386816:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787853618.440974:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853618.441002:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb054d6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2032 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853618.441100:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054d73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853618.441117:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054d73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853618.441131:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054d73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853618.441224:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787853618.441228:0:7618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853618.441259:0:7618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054d73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853618.441300:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb054d6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2032 expref: 55 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853618.441337:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054d73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2032 expref: 54 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853618.441346:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:2.0:1787853618.441349:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853618.441352:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71a00, rc 0) 00000100:00100000:2.0:1787853618.441436:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+54:10435:x1874700136386816:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 502us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853618.441444:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:2.0:1787853618.453797:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853618.453938:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136387200 00000100:00100000:1.0:1787853618.453950:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136387200 00000100:00100000:1.0:1787853618.454021:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:1.0:1787853618.454032:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+54:10435:x1874700136387200:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:1.0:1787853618.454452:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+55:10435:x1874700136387200:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 420us (669us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787853618.454462:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:0.0:1787853618.457782:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853618.458028:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136387328 00000100:00100000:3.0:1787853618.458043:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136387328 00000100:00100000:3.0:1787853618.458121:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:3.0:1787853618.458132:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+55:10435:x1874700136387328:12345-192.168.206.10@tcp:103:lfs.0 00010000:00010000:3.0:1787853618.458152:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787853618.458199:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054d03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2016 expref: 55 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.458224:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196a00/0xcf1365f7cb054d5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd202b expref: 54 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.458255:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb054c0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1fd7 expref: 53 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.458266:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1800) 00010000:00010000:3.0:1787853618.458278:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853618.458343:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+52:10435:x1874700136387328:12345-192.168.206.10@tcp:103:lfs.0 Request processed in 212us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853618.458351:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:2.0:1787853618.463298:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853618.463450:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136387456 00000100:00100000:1.0:1787853618.463462:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136387456 00000100:00100000:1.0:1787853618.463543:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:1.0:1787853618.463555:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+52:10435:x1874700136387456:12345-192.168.206.10@tcp:58:lfs.0 00010000:00010000:1.0:1787853618.463988:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb054d7a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853618.464009:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb054d7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853618.464022:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb054d7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787853618.464486:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787853618.465089:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787853618.465173:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787853618.466227:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+52:10435:x1874700136387456:12345-192.168.206.10@tcp:58:lfs.0 Request processed in 2663us (2933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853618.466241:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:3.0:1787853618.508139:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853618.508224:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136387584 00000100:00100000:3.0:1787853618.508236:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136387584 00000100:00100000:3.0:1787853618.508306:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 67 00000100:00100000:3.0:1787853618.508318:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+52:10437:x1874700136387584:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787853618.508345:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853618.508370:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054d81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2039 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.508466:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054d88 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.508492:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054d88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.508517:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054d88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.508535:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054d8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.508551:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.508558:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.508996:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054d96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.509007:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054d96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.509016:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054d96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853618.509059:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787853618.509064:0:7618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853618.509086:0:7618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054d96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.509098:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054d96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.509108:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054d88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.509115:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054d88 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.509122:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054d88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.509139:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064dc00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853618.509143:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054d88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.509152:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054d88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.509167:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:3.0:1787853618.509170:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853618.509175:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054d88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.509194:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054d88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.509208:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.509214:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054d8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.509220:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054d8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.509225:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853618.509228:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054d8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.509234:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054d8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.509253:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff992742cdd800) 00010000:00010000:3.0:1787853618.509255:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853618.509258:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054d8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.509264:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054d8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.509300:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054d81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2039 expref: 54 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.509315:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054d96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2039 expref: 53 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853618.509323:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1600) 00010000:00010000:3.0:1787853618.509325:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787853618.509328:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064cc00, rc 0) 00000100:00100000:3.0:1787853618.509413:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+53:10437:x1874700136387584:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1096us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853618.509423:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 67 00000001:00080000:0.0:1787853618.575264:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000001:00080000:0.0:1787853618.575339:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:0.0:1787853618.575368:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1787853618.575394:0:5846:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99276d54e6c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1787853618.575400:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff992775506d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99276d54e240 00000020:00080000:0.0:1787853618.575403:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff992775506e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99277c580000 00000020:00080000:0.0:1787853618.575448:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1787853618.575637:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787853618.576111:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152140544:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787853618.576212:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853618.576610:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152140544 00000100:00100000:2.0:1787853618.576620:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152140544 00000100:00100000:2.0:1787853618.576717:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787853618.576728:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3297:x1874700152140544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787853618.576759:0:6673:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787853618.576805:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a907b2f, atime: 0x6a907b30, ctime: 0x6a907b2f, blocks: 0x1 00010000:00010000:2.0:1787853618.576814:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072ab78fc/0xcf1365f7cb054d9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853618.576842:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=312s v=(0 0) 00010000:00010000:2.0:1787853618.576848:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853618.576855:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072ab78fc/0xcf1365f7cb054d9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853618.576875:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072ab78fc/0xcf1365f7cb054d9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853618.576903:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072ab78fc/0xcf1365f7cb054d9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853618.576910:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072ab78fc/0xcf1365f7cb054d9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853618.576926:0:6673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1787853618.577546:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787853618.577773:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853618.577781:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072ab78fc/0xcf1365f7cb054d9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.577792:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70c00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853618.577797:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072ab78fc/0xcf1365f7cb054d9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.577807:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072ab78fc/0xcf1365f7cb054d9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.577829:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072ab78fc/0xcf1365f7cb054d9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.577893:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072ab78fc/0xcf1365f7cb054d9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853618.577938:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853618.577940:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853618.577942:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853618.580169:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3297:x1874700152140544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3432us (3945us total) trans 4294967301 rc 0/0 00000004:00080000:0.0:1787853618.580543:0:3297:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff992761ea6940/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787853618.580553:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152140544:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787853618.582957:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787853619.015429:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853619.015460:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152140672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853619.015558:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853619.015709:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152140672 00000100:00100000:2.0:1787853619.015719:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152140672 00000100:00100000:2.0:1787853619.015784:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787853619.015795:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3297:x1874700152140672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853619.015841:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853619.015903:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3297:x1874700152140672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853619.015911:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787853619.015968:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152140672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853619.016365:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152141056:0@lo:400:kworker.0 00000100:00100000:2.0:1787853619.016415:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853619.016441:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853619.016448:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c201680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152141184:0@lo:400:kworker.0 00000100:00100000:2.0:1787853619.016476:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853619.016525:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152141056 00000100:00100000:2.0:1787853619.016531:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152141056 00000100:00100000:2.0:1787853619.016576:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787853619.016585:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c201a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152141056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853619.016628:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c201a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152141056:12345-0@lo:400:kworker.0 Request processed in 44us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853619.016635:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787853619.016657:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152141184 00000100:00100000:2.0:1787853619.016662:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152141184 00000100:00100000:2.0:1787853619.016741:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787853619.016749:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c203c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152141184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853619.016783:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c203c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152141184:12345-0@lo:400:kworker.0 Request processed in 35us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853619.016789:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787853619.016819:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c201680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152141184:0@lo:400:kworker.0 00000100:00100000:2.0:1787853619.016829:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152141056:0@lo:400:kworker.0 00000100:00100000:1.0:1787853619.017049:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152140800:0@lo:400:kworker.0 00000100:00100000:1.0:1787853619.017089:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853619.017117:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c201e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152141312:0@lo:400:kworker.0 00000100:00100000:1.0:1787853619.017140:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853619.017161:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787853619.017167:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152140928:0@lo:400:kworker.0 00000100:00100000:1.0:1787853619.017203:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787853619.017235:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787853619.017240:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853619.017252:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152141312 00000100:00100000:1.0:1787853619.017256:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152141312 00000100:00100000:1.0:1787853619.017287:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152140928 00000100:00100000:1.0:1787853619.017290:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152140928 00000100:00100000:1.0:1787853619.017304:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787853619.017310:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152141312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853619.017349:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152141312:12345-0@lo:400:kworker.0 Request processed in 39us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853619.017356:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787853619.017369:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787853619.017375:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152140928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853619.017474:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152140928:12345-0@lo:400:kworker.0 Request processed in 26us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853619.017482:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787853619.017721:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152140800 00000100:00100000:2.0:1787853619.017726:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152140800 00000100:00100000:2.0:1787853619.017759:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787853619.017767:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152140800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853619.017802:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152140800:12345-0@lo:400:kworker.0 Request processed in 36us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853619.017808:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:0.0:1787853619.018751:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853619.029829:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152140928:0@lo:400:kworker.0 00000100:00100000:0.0:1787853619.029851:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152140800:0@lo:400:kworker.0 00000100:00100000:0.0:1787853619.029866:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c201e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152141312:0@lo:400:kworker.0 00010000:00010000:3.0:1787853619.078504:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787853619.339622:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787853619.339634:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787853619.340736:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787853619.340750:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787853619.341110:0:11666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7a6580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874700152141440:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787853619.342911:0:11666:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853619.354574:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853619.354626:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136387712 00000100:00100000:3.0:1787853619.354638:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136387712 00000100:00100000:3.0:1787853619.354740:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:3.0:1787853619.354752:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+12:10448:x1874700136387712:12345-192.168.206.10@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787853619.354852:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+12:10448:x1874700136387712:12345-192.168.206.10@tcp:900:lhsmtool_posix.0 Request processed in 101us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853619.354861:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00080000:3.0:1787853619.354887:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853619.355701:0:11666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7a6580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874700152141440:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787853619.365943:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853619.366046:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136387840 00000100:00100000:2.0:1787853619.366058:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136387840 00000100:00100000:2.0:1787853619.366137:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:2.0:1787853619.366149:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+11:10448:x1874700136387840:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787853619.366200:0:5825:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787853619.366326:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+11:10448:x1874700136387840:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 180us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853619.366334:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:1.0:1787853619.370261:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853619.371257:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136387968 00000100:00100000:0.0:1787853619.371270:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136387968 00000100:00100000:0.0:1787853619.371360:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:0.0:1787853619.371371:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+11:10448:x1874700136387968:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787853619.371460:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb054da4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371480:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb054da4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371495:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb054da4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371525:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb054dab lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371534:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb054dab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371541:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb054dab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371578:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054db2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371587:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371594:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853619.371640:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787853619.371645:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853619.371660:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371700:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb054da4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371708:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb054da4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371715:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb054da4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371730:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c7800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853619.371735:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb054da4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371744:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb054da4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371758:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff992761dc9700) 00010000:00010000:0.0:1787853619.371761:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853619.371766:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb054da4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371773:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb054da4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371787:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb054dab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371793:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb054dab lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371800:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb054dab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371805:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c6800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853619.371808:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb054dab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371815:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb054dab lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371834:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff992761dc9800) 00010000:00010000:0.0:1787853619.371836:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853619.371839:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb054dab lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371845:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb054dab lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371860:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371866:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054db2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371872:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054db2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371877:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853619.371880:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054db2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371886:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054db2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371893:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1600) 00010000:00010000:0.0:1787853619.371896:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853619.371899:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054db2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.371904:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054db2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853619.372014:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+11:10448:x1874700136387968:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 Request processed in 643us (1765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853619.372023:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:3.0:1787853619.379507:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853619.382656:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136388224 00000100:00100000:2.0:1787853619.382686:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136388224 00000100:00100000:2.0:1787853619.382765:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 70 00000100:00100000:2.0:1787853619.382777:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761eaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+11:10448:x1874700136388224:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853619.382802:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853619.382827:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb054db9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2040 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.382950:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054dc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.382968:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.382982:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853619.382996:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787853619.383247:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.383258:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054dc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.383280:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.383287:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853619.383292:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.383301:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054dc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.383316:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1600) 00010000:00010000:2.0:1787853619.383320:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853619.383325:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054dc0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.383332:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054dc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.383381:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb054db9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2040 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.383392:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff992761dc9700) 00010000:00010000:2.0:1787853619.383395:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787853619.383399:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb054db9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2040 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.383409:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70e00, rc 0) 00000100:00100000:2.0:1787853619.383492:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761eaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+12:10448:x1874700136388224:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 717us (3997us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1787853619.383509:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 70 00000100:00100000:0.0:1787853619.391532:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853619.391579:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136388352 00000100:00100000:0.0:1787853619.391590:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136388352 00000100:00100000:0.0:1787853619.391663:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00100000:0.0:1787853619.391705:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+12:10448:x1874700136388352:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787853619.391775:0:5824:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787853619.391908:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+12:10448:x1874700136388352:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 235us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853619.391917:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 71 00000040:00080000:1.0:1787853619.399486:0:11981:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787853619.399499:0:11981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787853619.399551:0:11981:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787853619.399560:0:11981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787853619.404441:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853619.404504:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136388608 00000100:00100000:2.0:1787853619.404515:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136388608 00000100:00100000:2.0:1787853619.404633:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 72 00000100:00100000:2.0:1787853619.404646:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+12:10448:x1874700136388608:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853619.404670:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853619.404689:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787853619.404721:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054d73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2032 expref: 12 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.404746:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:2.0:1787853619.404752:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853619.404768:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054dce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2047 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787853619.405786:0:5825:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787853619.406084:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb054dd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.406103:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb054dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.406116:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb054dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.406200:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054dce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2047 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.406232:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb054dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2047 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.406242:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff992743be3900) 00010000:00010000:2.0:1787853619.406245:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853619.406248:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70e00, rc 0) 00000100:00100000:2.0:1787853619.406330:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c203480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+13:10448:x1874700136388608:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 1687us (1902us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1787853619.406340:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 72 00000100:00100000:3.0:1787853619.417775:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853619.417826:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136388864 00000100:00100000:3.0:1787853619.417838:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136388864 00000100:00100000:3.0:1787853619.417898:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 73 00000100:00100000:3.0:1787853619.417909:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+13:10448:x1874700136388864:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787853619.417980:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853619.418013:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb054dd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2047 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.418034:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff992743be3900) 00010000:00010000:3.0:1787853619.418047:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787853619.418073:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054de3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.418088:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054de3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.418099:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054de3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.419777:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054dea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xadd371e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.419800:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054dea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xadd371e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.419813:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054dea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xadd371e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.422397:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054de3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.422413:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054de3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.422422:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054de3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.422428:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853619.422433:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054de3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.422441:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054de3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.422577:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:3.0:1787853619.422581:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853619.422587:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054de3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.422594:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054de3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.422618:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054dea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xadd371e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.422624:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054dea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xadd371e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.422631:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054dea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xadd371e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.422638:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064c600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853619.422642:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054dea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xadd371e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.422649:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054dea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xadd371e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.422659:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xadd371e8 (ffff992742cdd800) 00010000:00010000:3.0:1787853619.422662:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853619.422665:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054dea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xadd371e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.422690:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054dea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xadd371e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853619.422793:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+12:10448:x1874700136388864:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 4881us (5031us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787853619.422802:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 73 00000100:00100000:3.0:1787853619.434885:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853619.435121:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136388992 00000100:00100000:0.0:1787853619.435130:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136388992 00000100:00100000:0.0:1787853619.435196:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 74 00000100:00100000:0.0:1787853619.435206:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+12:10448:x1874700136388992:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853619.435224:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853619.435242:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054df1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd204e expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.435273:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054df8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.435285:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054df8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.435296:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054df8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.435385:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054df1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd204e expref: 14 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.435401:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054df8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd204e expref: 13 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.435409:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff992761dc9800) 00010000:00010000:0.0:1787853619.435412:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787853619.435415:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992740030400, rc 0) 00000100:00100000:0.0:1787853619.435469:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+13:10448:x1874700136388992:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 265us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853619.435476:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 74 00000100:00100000:0.0:1787853619.445902:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853619.446791:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136389248 00000100:00100000:0.0:1787853619.446810:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136389248 00000100:00100000:0.0:1787853619.446870:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 75 00000100:00100000:0.0:1787853619.446880:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+13:10448:x1874700136389248:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787853619.446959:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054dff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.446985:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054dff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.446998:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054dff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787853619.447270:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1787853619.447295:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 313744621737ns, next at 314744619602ns, rc = 0 00000004:00010000:0.0:1787853619.447389:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f76ab45f reply state 0000000098c4436c transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054dff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853619.447399:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787853619.447496:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:10448:x1874700136389248:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 617us (1602us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787853619.447505:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 75 00010000:00010000:1.0:1787853619.450256:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054dff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.450272:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054dff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.450281:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054dff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.450287:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853619.450292:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054dff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.450300:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054dff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.450317:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff992761dc9800) 00010000:00010000:1.0:1787853619.450320:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787853619.450325:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054dff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.450331:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054dff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853619.455496:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853619.455566:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136389376 00000100:00100000:2.0:1787853619.455583:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136389376 00000100:00100000:2.0:1787853619.456020:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:2.0:1787853619.456034:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:10448:x1874700136389376:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853619.456066:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853619.456094:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054e06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2055 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.456917:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054e06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2055 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.456956:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054e06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2055 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.456989:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff992761dc9800) 00010000:00010000:2.0:1787853619.456994:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787853619.457013:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70400, rc 0) 00000100:00100000:2.0:1787853619.457102:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:10448:x1874700136389376:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 1071us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853619.457112:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:3.0:1787853619.460479:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853619.460544:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136389504 00000100:00100000:0.0:1787853619.460553:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136389504 00000100:00100000:0.0:1787853619.460589:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:0.0:1787853619.460596:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1874700136389504:12345-192.168.206.10@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787853619.460625:0:6672:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:0.0:1787853619.460657:0:6672:0:(genops.c:1385:class_connect()) connect: client 0d6ecd6d-a011-4e2a-a67c-6551aba162fe, cookie 0xcf1365f7cb054e0d 00002000:00100000:0.0:1787853619.460668:0:6672:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0d6ecd6d-a011-4e2a-a67c-6551aba162fe/ffff992743663800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113953 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787853619.460719:0:6672:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787853619.460914:0:6672:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787853619.460945:0:6672:0:(import.c:65:import_set_state_nolock()) ffff992743665000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853619.461111:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2361:x1874700136389504:12345-192.168.206.10@tcp:8:lhsmtool_posix.0 Request processed in 513us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853619.461120:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:2.0:1787853619.471083:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853619.471602:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136389632 00000100:00100000:0.0:1787853619.471613:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136389632 00000100:00100000:0.0:1787853619.471694:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00080000:3.0:1787853619.471698:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853619.471704:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c2030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:0:x1874700136389632:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00000001:00080000:3.0:1787853619.511496:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:3.0:1787853619.511513:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0d6ecd6d-a011-4e2a-a67c-6551aba162fe 00000100:00100000:1.0:1787853619.511884:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c2030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:0:x1874700136389632:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 40175us (40808us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787853619.511895:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00100000:2.0:1787853619.522055:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853619.522134:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136389888 00000100:00100000:1.0:1787853619.522147:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136389888 00000100:00100000:1.0:1787853619.522232:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:1.0:1787853619.522256:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c203840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:10448:x1874700136389888:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787853619.522608:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c203840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+16:10448:x1874700136389888:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 352us (560us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1787853619.522617:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:3.0:1787853619.535029:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853619.535130:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136390144 00000100:00100000:0.0:1787853619.535142:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136390144 00000100:00100000:0.0:1787853619.535316:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:0.0:1787853619.535328:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+16:10448:x1874700136390144:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787853619.535469:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+16:10448:x1874700136390144:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 142us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853619.535478:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:3.0:1787853619.540707:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853619.541032:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136390272 00000100:00100000:2.0:1787853619.541043:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136390272 00000100:00100000:2.0:1787853619.541114:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 78 00000100:00100000:2.0:1787853619.541126:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+16:10448:x1874700136390272:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853619.541156:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853619.541193:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71600/0xcf1365f7cb054e14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd205c expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.541282:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054e1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.541299:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054e1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.541314:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054e1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853619.541358:0:7618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853619.541379:0:7618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054e1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.541410:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71600/0xcf1365f7cb054e14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd205c expref: 18 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.541445:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054e1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd205c expref: 17 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.541456:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff992761dc9800) 00010000:00010000:2.0:1787853619.541460:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787853619.541463:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70c00, rc 0) 00000100:00100000:2.0:1787853619.541534:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+17:10448:x1874700136390272:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 411us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853619.541542:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 78 00000100:00100000:3.0:1787853619.547296:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853619.547385:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136390400 00000100:00100000:1.0:1787853619.547396:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136390400 00000100:00100000:1.0:1787853619.547458:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:1.0:1787853619.547467:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136390400:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853619.547489:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853619.547515:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014bc012f/0xcf1365f7cb054e22 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2063 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787853619.547548:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a907b33, blocks: 0x1 00010000:00010000:1.0:1787853619.547571:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=313s v=(0 0) 00010000:00010000:1.0:1787853619.547576:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853619.547586:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014bc012f/0xcf1365f7cb054e22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2063 expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.547608:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000014bc012f/0xcf1365f7cb054e22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2063 expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.547621:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766197800, rc 0) 00000100:00100000:1.0:1787853619.547709:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2365:x1874700136390400:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 242us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853619.547716:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:1.0:1787853619.556352:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853619.556661:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136390656 00000100:00100000:0.0:1787853619.556829:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136390656 00000100:00100000:1.0:1787853619.556972:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 79 00000100:00100000:1.0:1787853619.556983:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+17:10448:x1874700136390656:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787853619.557112:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+17:10448:x1874700136390656:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 130us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853619.557120:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 79 00000100:00100000:2.0:1787853619.565315:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853619.565394:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136390784 00000100:00100000:0.0:1787853619.565406:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136390784 00000100:00100000:0.0:1787853619.565468:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:0.0:1787853619.565478:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c201680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:10448:x1874700136390784:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853619.565501:0:11669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853619.565521:0:11669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb054e29 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd206a expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.565559:0:11669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000014bc012f/0xcf1365f7cb054e22 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2063 expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.565571:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853619.565577:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853619.565583:0:11669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb054e29 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd206a expref: 7 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.565624:0:11669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000014bc012f/0xcf1365f7cb054e22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2063 expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.565650:0:11669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000014bc012f/0xcf1365f7cb054e22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2063 expref: 7 pid: 6672 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853619.565666:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dc9d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11669:1874700152141568:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787853619.565947:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927463b3840 going to sleep for 11 seconds 00000100:00100000:2.0:1787853619.577902:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dc9d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11669:1874700152141568:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787853619.577957:0:11669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb054e29 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd206a expref: 7 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.577986:0:11669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927821c6800, rc 0) 00000100:00100000:2.0:1787853619.578079:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c201680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:10448:x1874700136390784:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 12599us (12774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853619.578091:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:2.0:1787853619.580848:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853619.580888:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136390912 00000100:00100000:2.0:1787853619.580900:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136390912 00010000:00010000:2.0:1787853619.580949:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000014bc012f/0xcf1365f7cb054e22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2063 expref: 7 pid: 6672 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853619.580993:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:2.0:1787853619.581015:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274415c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2365:x1874700136390912:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853619.581035:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853619.581064:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000014bc012f/0xcf1365f7cb054e22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2063 expref: 7 pid: 6672 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.581080:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000014bc012f/0xcf1365f7cb054e22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2063 expref: 7 pid: 6672 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.581109:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014bc012f/0xcf1365f7cb054e22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2063 expref: 7 pid: 6672 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.581128:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853619.581133:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853619.581143:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb054e29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd206a expref: 6 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.581153:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb054e29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd206a expref: 6 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.581326:0:5809:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb054e29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd206a expref: 6 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853619.581345:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c201e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5809:1874700152141696:192.168.206.10@tcp:105: 00000100:00100000:2.0:1787853619.581437:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff992745a56a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787853619.590876:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853619.590936:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136391040 00000100:00100000:3.0:1787853619.590948:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136391040 00002000:00100000:3.0:1787853619.591019:0:6678:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff99277c78d2c0 x1874700136391040/t0(0) o4->0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp:40/0 lens 504/0 e 0 to 0 dl 1787853630 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787853619.591035:0:6678:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99277c78d2c0 with x1874700136391040 ext(0->8) 00002000:00010000:3.0:1787853619.591041:0:6678:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99277c78d2c0 00000100:00100000:3.0:1787853619.591073:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:3.0:1787853619.591084:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2364:x1874700136391040:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787853619.591474:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c201e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5809:1874700152141696:192.168.206.10@tcp:105: 00010000:00010000:2.0:1787853619.591516:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853619.591648:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274415c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2365:x1874700136390912:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 10633us (10810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853619.591659:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:3.0:1787853619.599756:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2364:x1874700136391040:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 Request processed in 8663us (8884us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787853619.599771:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00002000:00100000:3.0:1787853619.599785:0:6678:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff99277c78d2c0 x1874700136391040/t4294967302(0) o4->0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp:40/0 lens 504/448 e 0 to 0 dl 1787853630 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787853619.599796:0:6678:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99277c78d2c0 with x1874700136391040 ext(0->8) 00002000:00010000:3.0:1787853619.599803:0:6678:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99277c78d2c0 00000100:00100000:3.0:1787853619.606172:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853619.606285:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136391168 00000100:00100000:2.0:1787853619.606301:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136391168 00000100:00100000:2.0:1787853619.606386:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 80 00000100:00100000:2.0:1787853619.606398:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+17:10448:x1874700136391168:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787853619.662852:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:0.0:1787853619.662869:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787853619.662901:0:5846:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1787853619.662919:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000100:00100000:3.0:1787853619.662987:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:10448:x1874700136391168:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 Request processed in 56583us (56816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853619.663000:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 80 00000020:00080000:0.0:1787853619.663135:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1787853619.663224:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787853619.663267:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c201e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152141824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787853619.663416:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853619.663532:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152141824 00000100:00100000:2.0:1787853619.663543:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152141824 00000100:00100000:2.0:1787853619.663603:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787853619.663617:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152141824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787853619.663853:0:6672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787853619.663857:0:6672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787853619 00002000:00010000:2.0:1787853619.663860:0:6672:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787853619.663862:0:6672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787853619 -> 1787853619 00002000:00010000:2.0:1787853619.663865:0:6672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787853619.663905:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1874700152141824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 291us (489us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787853619.663912:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1787853619.665296:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99277c201e00/2, rc 0, transno 4294967303 00000100:00100000:0.0:1787853619.665313:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c201e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152141824:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787853619.668330:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853619.668566:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136391296 00000100:00100000:1.0:1787853619.668579:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136391296 00000100:00100000:1.0:1787853619.668651:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 30 00000100:00100000:1.0:1787853619.668662:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2365:x1874700136391296:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787853619.731095:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1787853619.731115:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1787853619.731373:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2365:x1874700136391296:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 Request processed in 62704us (63047us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853619.731388:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 30 00000100:00100000:2.0:1787853619.734765:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853619.738913:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136391552 00000100:00100000:1.0:1787853619.738939:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136391552 00000100:00100000:1.0:1787853619.739048:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:1.0:1787853619.739061:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+13:10448:x1874700136391552:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787853619.739144:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853619.739193:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054e1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd205c expref: 13 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.739221:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff992761dc9800) 00010000:00010000:1.0:1787853619.739228:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853619.739270:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb054e30 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.739313:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb054e30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.739325:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb054e30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787853619.739799:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024986017 reply state 000000001046b158 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb054e30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853619.739812:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787853619.739975:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:10448:x1874700136391552:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 914us (5223us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1787853619.739985:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 81 00010000:00010000:0.0:1787853619.747598:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb054e30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.747623:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb054e30 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.747633:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb054e30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.747640:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197a00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853619.747646:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb054e30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.747729:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb054e30 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.747753:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff992761dc9800) 00010000:00010000:0.0:1787853619.747757:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853619.747764:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb054e30 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.747771:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb054e30 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853619.749032:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853619.749374:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136391680 00000100:00100000:0.0:1787853619.749388:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136391680 00000100:00100000:0.0:1787853619.749464:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 31 00000100:00100000:0.0:1787853619.749477:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2364:x1874700136391680:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787853619.750023:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787853619.750028:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787853619 -> 1787853617 00002000:00010000:0.0:1787853619.750031:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787853616 00002000:00010000:0.0:1787853619.750033:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787853619 -> 1787853617 00002000:00010000:0.0:1787853619.750035:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787853619.750344:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2364:x1874700136391680:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 867us (1321us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787853619.750355:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 31 00000100:00100000:2.0:1787853619.758667:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853619.758976:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136391936 00000100:00100000:0.0:1787853619.758988:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136391936 00000100:00100000:3.0:1787853619.759853:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 82 00000100:00100000:3.0:1787853619.759869:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+13:10448:x1874700136391936:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787853619.759968:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.759988:0:7618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054df8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd204e expref: 13 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.759999:0:7618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e37 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.760045:0:7618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054df8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd204e expref: 13 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.760062:0:7618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054df8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd204e expref: 13 pid: 7618 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853619.760079:0:7618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7618:1874700152141952:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787853619.760219:0:7618:0:(client.c:2715:ptlrpc_set_wait()) set ffff992742d6d900 going to sleep for 11 seconds 00000100:00100000:2.0:1787853619.764792:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853619.765145:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136392064 00000100:00100000:0.0:1787853619.765156:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136392064 00010000:00010000:0.0:1787853619.765217:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054df8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd204e expref: 14 pid: 7618 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853619.765284:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:0.0:1787853619.765296:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:2364:x1874700136392064:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853619.765315:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853619.765322:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054df8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd204e expref: 14 pid: 7618 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.765336:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054df8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd204e expref: 14 pid: 7618 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.765477:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff992761dc9800) 00010000:00010000:0.0:1787853619.765484:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.765496:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.765504:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e37 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.765527:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853619.765784:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:2364:x1874700136392064:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 478us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853619.765793:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 43 00010000:00010000:3.0:1787853619.768935:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054df8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd204e expref: 13 pid: 7618 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853619.768977:0:7618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7618:1874700152141952:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787853619.769015:0:7618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.769028:0:7618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.769060:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.769099:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.769107:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e37 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.769114:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.769121:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064c200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853619.769127:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.769135:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e37 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.769158:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff992761dc9800) 00010000:00010000:3.0:1787853619.769161:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787853619.769167:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e37 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.769184:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853619.769310:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+12:10448:x1874700136391936:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 Request processed in 9444us (10657us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787853619.769322:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 82 00000100:00100000:2.0:1787853619.776097:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853619.776972:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136392192 00000100:00100000:0.0:1787853619.776987:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136392192 00000100:00100000:0.0:1787853619.777069:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:0.0:1787853619.777082:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2364:x1874700136392192:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787853619.777154:0:11669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004506be3e/0xcf1365f7cb054e3e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.777195:0:11669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb054e29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd206a expref: 7 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.777207:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787853619.777212:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787853619.777218:0:11669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004506be3e/0xcf1365f7cb054e3e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.777264:0:11669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb054e29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd206a expref: 7 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.777281:0:11669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb054e29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd206a expref: 7 pid: 11669 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853619.777300:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dc9cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11669:1874700152142080:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787853619.777416:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927463b3300 going to sleep for 11 seconds 00000100:00100000:2.0:1787853619.779788:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dc9cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11669:1874700152142080:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787853619.779826:0:11669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004506be3e/0xcf1365f7cb054e3e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853619.781533:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853619.781647:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136392320 00000100:00100000:0.0:1787853619.781660:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136392320 00010000:00010000:0.0:1787853619.781759:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb054e29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd206a expref: 8 pid: 11669 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853619.781856:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:0.0:1787853619.781868:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2365:x1874700136392320:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853619.781906:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853619.783326:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb054e29 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd206a expref: 8 pid: 11669 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.783522:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb054e29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd206a expref: 8 pid: 11669 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.783631:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb054e29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd206a expref: 8 pid: 11669 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.783655:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853619.783661:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853619.783668:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004506be3e/0xcf1365f7cb054e3e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.783731:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004506be3e/0xcf1365f7cb054e3e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.783847:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853619.783993:0:11669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004506be3e/0xcf1365f7cb054e3e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853619.784001:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2365:x1874700136392320:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 2131us (2474us total) trans 0 rc 0/0 00010000:00010000:1.0:1787853619.784012:0:11669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004506be3e/0xcf1365f7cb054e3e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853619.784018:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 44 00010000:00010000:1.0:1787853619.784060:0:11669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004506be3e/0xcf1365f7cb054e3e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.784070:0:11669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004506be3e/0xcf1365f7cb054e3e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.784078:0:11669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004506be3e/0xcf1365f7cb054e3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.784105:0:11669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c7800 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:1.0:1787853619.784110:0:11669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004506be3e/0xcf1365f7cb054e3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.784119:0:11669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004506be3e/0xcf1365f7cb054e3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.784143:0:11669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004506be3e/0xcf1365f7cb054e3e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.784151:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004506be3e/0xcf1365f7cb054e3e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853619.784237:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2364:x1874700136392192:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 Request processed in 7156us (8155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853619.784247:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:2.0:1787853619.786559:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853619.786644:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136392576 00000100:00100000:1.0:1787853619.786656:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136392576 00000100:00100000:1.0:1787853619.786753:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 83 00000100:00100000:1.0:1787853619.786764:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+12:10448:x1874700136392576:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787853619.786877:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb054e45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.786898:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb054e45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.786925:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb054e45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.787211:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054e4c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.787233:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054e06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2055 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.787243:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054e4c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.787283:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054e06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2055 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.787299:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054e06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2055 expref: 13 pid: 5825 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853619.788491:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7bad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5826:1874700152142208:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787853619.788623:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927660480c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853619.791647:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7bad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5826:1874700152142208:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787853619.791729:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054e4c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853619.793630:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853619.794193:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136392704 00000100:00100000:3.0:1787853619.794204:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136392704 00010000:00010000:3.0:1787853619.794254:0:8433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054e06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2055 expref: 14 pid: 5825 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853619.794430:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:3.0:1787853619.794444:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:2363:x1874700136392704:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853619.794481:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853619.794489:0:8433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054e06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2055 expref: 14 pid: 5825 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.794505:0:8433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054e06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2055 expref: 14 pid: 5825 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.794533:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054e06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2055 expref: 14 pid: 5825 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.794551:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff992761dc9800) 00010000:00010000:3.0:1787853619.794556:0:8433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054e4c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.794566:0:8433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054e4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.794575:0:8433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054e4c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.794611:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853619.794726:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+13:2363:x1874700136392704:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 285us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853619.794735:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 45 00010000:00010000:1.0:1787853619.794809:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054e4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.794817:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054e4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787853619.795087:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1787853619.795279:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1787853619.795345:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1787853619.795472:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7bad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5826:1874700152142336:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787853619.795539:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853619.795579:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff992760945e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787853619.795612:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152142336 00000100:00100000:1.0:1787853619.795618:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152142336 00000100:00100000:1.0:1787853619.795661:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787853619.795669:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5826:x1874700152142336:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787853619.795784:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5826:x1874700152142336:12345-0@lo:1000:mdt00_002.0 Request processed in 116us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853619.795792:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787853619.795835:0:5826:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1787853619.795842:0:5826:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99277c201e00, transno 4294967303 00000100:00100000:1.0:1787853619.795857:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7bad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5826:1874700152142336:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787853619.796398:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1787853619.796459:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7bad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5826:1874700152142464:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787853619.796494:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853619.796524:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152142464 00000100:00100000:1.0:1787853619.796528:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152142464 00000100:00100000:1.0:1787853619.796555:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787853619.796563:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5826:x1874700152142464:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787853619.796775:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5826:x1874700152142464:12345-0@lo:1000:mdt00_002.0 Request processed in 211us (279us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787853619.796800:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787853619.797026:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff992760945240 going to sleep for 11 seconds 00000100:00100000:1.0:1787853619.797056:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7bad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5826:1874700152142464:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787853619.797092:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054e4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.797103:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054e4c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.797113:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054e4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.797119:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853619.797125:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054e4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.797134:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054e4c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.797154:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff992761dc9800) 00010000:00010000:1.0:1787853619.797158:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787853619.797164:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054e4c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.797171:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb054e4c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.797232:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb054d7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.797240:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb054d7a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.797254:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb054d7a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.797259:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853619.797263:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb054d7a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.797269:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb054d7a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.797278:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1600) 00010000:00010000:1.0:1787853619.797281:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787853619.797284:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb054d7a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.797290:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb054d7a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.797315:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054e53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.797331:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054d96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2039 expref: 16 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.797341:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054e53 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.797369:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054d96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2039 expref: 16 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853619.797396:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054d96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2039 expref: 16 pid: 7618 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853619.797409:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c7ba940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5826:1874700152142592:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787853619.797476:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927660480c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853619.802840:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853619.803086:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136392832 00000100:00100000:2.0:1787853619.803097:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136392832 00010000:00010000:2.0:1787853619.803145:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054d96 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2039 expref: 17 pid: 7618 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853619.803201:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:2.0:1787853619.803212:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+17:2364:x1874700136392832:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853619.803231:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853619.803238:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054d96 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2039 expref: 17 pid: 7618 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.803254:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054d96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2039 expref: 17 pid: 7618 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.803284:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1600) 00010000:00010000:2.0:1787853619.803291:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054e53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.803303:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054e53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.803343:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054e53 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853619.803366:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853619.803429:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+17:2364:x1874700136392832:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 218us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853619.803437:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 46 00010000:00010000:0.0:1787853619.804080:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054d96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2039 expref: 16 pid: 7618 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853619.804101:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c7ba940 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5826:1874700152142592:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787853619.804130:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054e53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.804140:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054e53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.804146:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054e53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.804161:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054e53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.804169:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054e53 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.804197:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054e53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.804204:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853619.804209:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054e53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.804217:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054e53 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.804229:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1600) 00010000:00010000:0.0:1787853619.804243:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853619.804249:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054e53 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.804256:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb054e53 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.804271:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb054e45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.804277:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb054e45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.804284:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb054e45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.804289:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853619.804292:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb054e45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.804297:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb054e45 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.804305:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9927433f1600) 00010000:00010000:0.0:1787853619.804307:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787853619.804309:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb054e45 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.804315:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb054e45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853619.804777:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:10448:x1874700136392576:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 18013us (18229us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1787853619.805930:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 83 00000020:00080000:0.0:1787853619.805939:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787853619.806255:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787853619.806261:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787853619.806300:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787853619.806306:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787853619.809267:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853619.809425:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136393088 00000100:00100000:3.0:1787853619.809436:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136393088 00000100:00100000:3.0:1787853619.809512:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:3.0:1787853619.809524:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:10448:x1874700136393088:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787853619.810750:0:5827:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787853619.810869:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1787853619.810932:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.810953:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.810968:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.810977:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e5a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.810984:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e5a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.810991:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853619.811014:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787853619.811540:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+17:10448:x1874700136393088:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 2013us (2284us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787853619.811552:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 20 00000020:00080000:3.0:1787853619.811559:0:5827:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787853619.811704:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853619.811713:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.811722:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064c200 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853619.811740:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.811750:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.811776:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff992742cdd400) 00010000:00010000:0.0:1787853619.811779:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787853619.811785:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e5a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.811792:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054e5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853619.811812:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853619.811814:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853619.811815:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853620.102663:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787853620.869975:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787853620.869989:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787853620.870029:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787853620.870037:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787853621.125848:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787853621.304489:0:12034:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787853621.304503:0:12034:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787853621.304543:0:12034:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787853621.304551:0:12034:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787853621.418961:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853621.419078:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136393344 00000100:00100000:2.0:1787853621.419090:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136393344 00000100:00100000:2.0:1787853621.419191:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 84 00000100:00100000:2.0:1787853621.419203:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c201e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+17:10467:x1874700136393344:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787853621.419232:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853621.419437:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054e61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2071 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787853621.419769:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787853621.420048:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71600/0xcf1365f7cb054e68 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.420067:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71600/0xcf1365f7cb054e68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.420091:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71600/0xcf1365f7cb054e68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853621.420106:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787853621.420547:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb054e61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2071 expref: 20 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.420566:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71600/0xcf1365f7cb054e68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2071 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.420577:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:2.0:1787853621.420580:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787853621.420583:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71600, rc 0) 00000100:00100000:2.0:1787853621.420892:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c201e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:10467:x1874700136393344:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1689us (1943us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1787853621.420902:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 84 00000100:00100000:2.0:1787853621.423893:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853621.423996:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136393472 00000100:00100000:3.0:1787853621.424009:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136393472 00000100:00100000:3.0:1787853621.424081:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00100000:3.0:1787853621.424093:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:10467:x1874700136393472:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:3.0:1787853621.424279:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054e76 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.424305:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054e76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.424318:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054e76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.424336:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054e7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.424343:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.424349:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.424792:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054e84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.424803:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054e84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.424811:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054e84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853621.424862:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054e84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.424876:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054e76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.424892:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054e76 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.424900:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054e76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.424906:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853621.424911:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054e76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.424920:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054e76 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.424935:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:3.0:1787853621.424938:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853621.424944:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054e76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.424951:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054e76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.424972:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.424978:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054e7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.424984:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054e7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.424988:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064dc00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853621.424997:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054e7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.425003:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054e7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.425012:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff992742cdd200) 00010000:00010000:3.0:1787853621.425014:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853621.425018:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054e7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.425024:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054e7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.425041:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054e84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.425046:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054e84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.425051:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054e84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.425055:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064c600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853621.425058:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054e84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.425063:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054e84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.425069:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992742cddf00) 00010000:00010000:3.0:1787853621.425071:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853621.425082:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054e84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.425088:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054e84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853621.425295:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:10467:x1874700136393472:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 1200us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853621.425306:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00100000:2.0:1787853621.471007:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853621.471094:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136393728 00000100:00100000:3.0:1787853621.471108:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136393728 00000100:00100000:3.0:1787853621.471357:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:3.0:1787853621.471371:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:10470:x1874700136393728:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787853621.471398:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853621.471427:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054e8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2078 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.472023:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054e92 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.472043:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054e92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.472056:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054e92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.472076:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054e99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.472084:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.472104:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.473666:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054ea0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.473704:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.473715:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853621.473729:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787853621.473911:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054e92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.473921:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054e92 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.473930:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054e92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.473937:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853621.473943:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054e92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.473953:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054e92 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.473969:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:3.0:1787853621.473973:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853621.473987:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054e92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.473994:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054e92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.474008:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.474016:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054e99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.474023:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054e99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.474029:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853621.474032:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054e99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.474039:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054e99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.474047:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff992742cddf00) 00010000:00010000:3.0:1787853621.474049:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853621.474053:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054e99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.474058:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054e99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.474411:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054e8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2078 expref: 22 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.474609:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2078 expref: 21 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.474621:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853621.474624:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853621.474626:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064c600, rc 0) 00000100:00100000:3.0:1787853621.474753:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+21:10470:x1874700136393728:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 3385us (3760us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787853621.474826:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:2.0:1787853621.480767:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853621.481006:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136393856 00000100:00100000:0.0:1787853621.481019:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136393856 00000100:00100000:0.0:1787853621.481088:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 87 00000100:00100000:0.0:1787853621.481102:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+21:10470:x1874700136393856:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:0.0:1787853621.481201:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054eae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.481222:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.481237:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.481270:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.481278:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054eae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.481286:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.481292:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740030400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853621.481297:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.481306:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054eae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.481322:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992742cdd200) 00010000:00010000:0.0:1787853621.481325:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787853621.481331:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054eae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.481370:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054eae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853621.481471:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+21:10470:x1874700136393856:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 372us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853621.481479:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 87 00000100:00100000:0.0:1787853621.484565:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853621.484731:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136394112 00000100:00100000:2.0:1787853621.484743:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136394112 00000100:00100000:2.0:1787853621.484818:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:2.0:1787853621.484831:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274f704850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+21:10470:x1874700136394112:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787853621.485118:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274f704850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:10470:x1874700136394112:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 288us (564us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787853621.485127:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:2.0:1787853621.519283:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853621.519465:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136394368 00000100:00100000:3.0:1787853621.519478:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136394368 00000100:00100000:3.0:1787853621.519571:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 88 00000100:00100000:3.0:1787853621.519582:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:9991:x1874700136394368:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787853621.519612:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853621.519807:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054eb5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd207f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.519944:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054ebc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.519963:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054ea0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2078 expref: 23 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.519974:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054ebc lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.520014:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2078 expref: 23 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.520045:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054ea0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2078 expref: 23 pid: 7618 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853621.520061:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5825:1874700152142720:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787853621.520364:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff992742d6d000 going to sleep for 11 seconds 00000100:00100000:1.0:1787853621.524873:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853621.525026:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136394496 00000100:00100000:0.0:1787853621.525038:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136394496 00010000:00010000:0.0:1787853621.525103:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054ea0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2078 expref: 24 pid: 7618 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853621.525388:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5825:1874700152142720:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787853621.525423:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054ebc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853621.525844:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:0.0:1787853621.525858:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c203840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+24:2364:x1874700136394496:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853621.525879:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853621.525888:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054ea0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2078 expref: 24 pid: 7618 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.525903:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2078 expref: 24 pid: 7618 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.525930:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054ea0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2078 expref: 24 pid: 7618 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.525947:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992742cdd200) 00010000:00010000:0.0:1787853621.525953:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054ebc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.525978:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054ebc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.525986:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054ebc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.526015:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853621.526092:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c203840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+23:2364:x1874700136394496:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 237us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853621.526101:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 47 00010000:00010000:3.0:1787853621.526412:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054ebc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.526422:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054ebc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853621.526448:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787853621.527798:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054eb5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd207f expref: 24 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.527828:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054ebc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd207f expref: 23 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.527838:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853621.527841:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787853621.527844:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064d200, rc 0) 00000100:00100000:3.0:1787853621.527912:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+23:9991:x1874700136394368:12345-192.168.206.10@tcp:101:bash.0 Request processed in 8331us (8641us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787853621.527938:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 88 00000100:00100000:1.0:1787853621.531938:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853621.532148:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136394752 00000100:00100000:3.0:1787853621.532456:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136394752 00000100:00100000:3.0:1787853621.534107:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 89 00000100:00100000:3.0:1787853621.534126:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+23:9991:x1874700136394752:12345-192.168.206.10@tcp:36:bash.0 00010000:00010000:3.0:1787853621.534508:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054eca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.534540:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054eca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.534554:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054eca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787853621.534952:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1787853621.534987:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6713d27 reply state 000000002a564bef transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054eca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853621.534997:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787853621.535054:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1787853621.535360:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+27:9991:x1874700136394752:12345-192.168.206.10@tcp:36:bash.0 Request processed in 1238us (3432us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1787853621.535368:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 89 00000020:00080000:3.0:1787853621.535375:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787853621.537425:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054eca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.537444:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054eca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.537452:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054eca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.537460:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853621.537465:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054eca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.537473:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054eca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.537492:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992742cdd200) 00010000:00010000:0.0:1787853621.537497:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853621.537502:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054eca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.537530:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054eca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853621.538415:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853621.538566:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136394880 00000100:00100000:3.0:1787853621.538578:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136394880 00000100:00100000:3.0:1787853621.538793:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 90 00000100:00100000:3.0:1787853621.538806:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274368ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+26:9991:x1874700136394880:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787853621.538835:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853621.538870:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ed1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2086 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.538947:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ed1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2086 expref: 27 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.538962:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ed1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2086 expref: 27 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.538983:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853621.538987:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787853621.538990:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064dc00, rc 0) 00000100:00100000:3.0:1787853621.539064:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274368ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+27:9991:x1874700136394880:12345-192.168.206.10@tcp:101:bash.0 Request processed in 262us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853621.539072:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 90 00000100:00100000:1.0:1787853621.545269:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853621.545513:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136395008 00000100:00100000:2.0:1787853621.545527:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136395008 00000100:00100000:2.0:1787853621.545616:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:2.0:1787853621.545627:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274368b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:9991:x1874700136395008:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:2.0:1787853621.545649:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853621.545711:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034748a21/0xcf1365f7cb054ed8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd208d expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787853621.545746:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a907b31, atime: 0x6a907b30, ctime: 0x6a907b31, blocks: 0xb 00010000:00010000:2.0:1787853621.545775:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=315s v=(0 0) 00010000:00010000:2.0:1787853621.545781:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853621.545791:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034748a21/0xcf1365f7cb054ed8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd208d expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.545813:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000034748a21/0xcf1365f7cb054ed8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd208d expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.545837:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70000, rc 0) 00000100:00100000:2.0:1787853621.545905:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274368b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:9991:x1874700136395008:12345-192.168.206.10@tcp:101:bash.0 Request processed in 279us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853621.545913:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00080000:0.0:1787853621.548606:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853621.549080:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853621.549313:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136395136 00000100:00100000:3.0:1787853621.549326:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136395136 00002000:00010000:3.0:1787853621.549379:0:6676:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1787853621.549385:0:6676:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9927500d1680 with x1874700136395136 ext(0->18446744073709551615) 00002000:00010000:3.0:1787853621.549399:0:6676:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9927500d1680. 00000100:00100000:3.0:1787853621.549467:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:3.0:1787853621.549478:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2365:x1874700136395136:12345-192.168.206.10@tcp:10:bash.0 00002000:00010000:3.0:1787853621.549916:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787853621.549921:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787853617 -> 1787853621 00002000:00010000:3.0:1787853621.549924:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787853616 -> 1787853616 00002000:00010000:3.0:1787853621.549926:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787853617 -> 1787853621 00002000:00010000:3.0:1787853621.549929:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787853621.550072:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2365:x1874700136395136:12345-192.168.206.10@tcp:10:bash.0 Request processed in 593us (998us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787853621.550082:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 1 00002000:00010000:3.0:1787853621.550086:0:6676:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1787853621.550089:0:6676:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9927500d1680 with x1874700136395136 ext(0->18446744073709551615) 00002000:00010000:3.0:1787853621.550095:0:6676:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9927500d1680. 00000100:00100000:1.0:1787853621.625577:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853621.625687:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136395264 00000100:00100000:1.0:1787853621.625700:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136395264 00000100:00100000:1.0:1787853621.625900:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 91 00000100:00100000:1.0:1787853621.625914:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+27:10484:x1874700136395264:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:1.0:1787853621.626020:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054edf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626045:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054edf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626059:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054edf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626103:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb054ee6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626111:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb054ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626117:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb054ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626638:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb054eed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626651:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb054eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626660:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb054eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787853621.626740:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb054eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626754:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054edf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626760:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054edf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626768:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054edf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626774:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853621.626779:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054edf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626868:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054edf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626884:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:1.0:1787853621.626888:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853621.626894:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054edf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626900:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb054edf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626917:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb054ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626923:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb054ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626929:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb054ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626934:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853621.626937:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb054ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626942:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb054ee6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626949:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9927433f1a00) 00010000:00010000:1.0:1787853621.626952:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853621.626955:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb054ee6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626971:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb054ee6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626989:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb054eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.626996:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb054eed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.627002:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb054eed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.627006:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853621.627010:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb054eed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.627016:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb054eed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.627024:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992742cdd200) 00010000:00010000:1.0:1787853621.627026:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853621.627030:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb054eed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853621.627036:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb054eed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853621.627151:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+27:10484:x1874700136395264:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 1237us (1585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853621.627160:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 91 00000001:00080000:2.0:1787853621.679995:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:2.0:1787853621.680021:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1787853621.680031:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1787853621.682732:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853621.682845:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136395520 00000100:00100000:2.0:1787853621.682858:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136395520 00000100:00100000:2.0:1787853621.682949:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 92 00000100:00100000:2.0:1787853621.682961:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c242940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+27:10487:x1874700136395520:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787853621.682988:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853621.683015:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb054ef4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2094 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683108:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054efb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683127:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054efb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683140:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054efb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683157:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb054f02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683182:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb054f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683190:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb054f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683585:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054f09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683597:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683604:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853621.683628:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787853621.683782:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054efb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683791:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054efb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683798:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054efb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683805:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71a00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853621.683810:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054efb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683818:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054efb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683833:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:2.0:1787853621.683836:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853621.683842:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054efb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683848:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054efb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683863:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb054f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683870:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb054f02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683887:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb054f02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683892:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853621.683895:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb054f02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683901:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb054f02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683909:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff992743be3800) 00010000:00010000:2.0:1787853621.683911:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853621.683914:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb054f02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683920:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb054f02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683974:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb054ef4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2094 expref: 30 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683989:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054f09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2094 expref: 29 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.683997:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992742cdd200) 00010000:00010000:2.0:1787853621.683998:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787853621.684001:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70c00, rc 0) 00000100:00100000:2.0:1787853621.684092:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c242940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+29:10487:x1874700136395520:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1133us (1373us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787853621.684111:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 92 00000100:00100000:3.0:1787853621.705357:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853621.705429:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853621.705456:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853621.705496:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853621.705543:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136395904 00000100:00100000:3.0:1787853621.705554:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136395904 00000100:00100000:0.0:1787853621.705559:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136395648 00000100:00100000:0.0:1787853621.705566:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136395648 00000100:00100000:0.0:1787853621.705623:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136396032 00000100:00100000:0.0:1787853621.705628:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136396032 00000100:00100000:3.0:1787853621.705630:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:3.0:1787853621.705643:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2364:x1874700136395904:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853621.705664:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 129 00000100:00100000:0.0:1787853621.705697:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2365:x1874700136396032:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853621.705752:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2365:x1874700136396032:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 80us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853621.705766:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 129 00000100:00100000:0.0:1787853621.705789:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 93 00000100:00100000:0.0:1787853621.705797:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+29:10487:x1874700136395648:12345-192.168.206.10@tcp:54:lfs.0 00000100:00100000:2.0:1787853621.705852:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136395776 00000100:00100000:2.0:1787853621.705856:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136395776 00000100:00100000:2.0:1787853621.705887:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 285 00000100:00100000:2.0:1787853621.705893:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2365:x1874700136395776:12345-192.168.206.10@tcp:400:kworker.0 00010000:00010000:0.0:1787853621.706089:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054f17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.706108:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054ebc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd207f expref: 29 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.706119:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054f17 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.706160:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054ebc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd207f expref: 29 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.706215:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054ebc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd207f expref: 29 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853621.706231:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dc9e580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5824:1874700152142848:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787853621.709723:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2364:x1874700136395904:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 4066us (4208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853621.710139:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:0.0:1787853621.710584:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927463b3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787853621.710834:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2365:x1874700136395776:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 4936us (5400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853621.710847:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 285 00000100:00080000:3.0:1787853621.710887:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787853621.710897:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787853621.714800:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853621.715742:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dc9e580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5824:1874700152142848:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787853621.715782:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054f17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853621.715809:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136396288 00000100:00100000:1.0:1787853621.715819:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136396288 00000100:00100000:1.0:1787853621.715997:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:1.0:1787853621.716009:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+30:5600:x1874700136396288:12345-192.168.206.10@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787853621.716422:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+31:5600:x1874700136396288:12345-192.168.206.10@tcp:35:ldlm_bl.0 Request processed in 414us (1633us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787853621.716431:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:1.0:1787853621.718973:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853621.719081:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136396416 00000100:00100000:3.0:1787853621.719091:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136396416 00010000:00010000:3.0:1787853621.719140:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054ebc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd207f expref: 31 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853621.719200:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:3.0:1787853621.719211:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c241a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+31:2365:x1874700136396416:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853621.719226:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853621.719249:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054ebc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd207f expref: 31 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.719263:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054ebc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd207f expref: 31 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.719293:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054ebc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd207f expref: 31 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.719312:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853621.719318:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054f17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.719328:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.719338:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054f17 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.719472:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853621.719540:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c241a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+30:2365:x1874700136396416:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 331us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853621.719549:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 48 00010000:00010000:0.0:1787853621.721376:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.721394:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.721429:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.721436:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054f17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.721442:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054f17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.721448:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740030400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853621.721453:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054f17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.721459:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054f17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.721490:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992742cdd200) 00010000:00010000:0.0:1787853621.721493:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787853621.721499:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054f17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.721506:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054f17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853621.721600:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+29:10487:x1874700136395648:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 15800us (16253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853621.721701:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 93 00000100:00100000:1.0:1787853621.730005:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853621.730096:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136396672 00000100:00100000:2.0:1787853621.730113:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136396672 00000100:00100000:2.0:1787853621.730315:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:2.0:1787853621.730328:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c2403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+29:10487:x1874700136396672:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787853621.730627:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c2403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+30:10487:x1874700136396672:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 301us (629us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787853621.730637:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:3.0:1787853621.808576:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853621.808647:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136396928 00000100:00100000:0.0:1787853621.808661:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136396928 00000100:00100000:0.0:1787853621.808841:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 94 00000100:00100000:0.0:1787853621.808856:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+30:10498:x1874700136396928:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:0.0:1787853621.808892:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853621.808980:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054f1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd209b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.809077:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054f25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.809192:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054f25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.809205:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054f25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.809224:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054f2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.809231:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.809237:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.809781:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054f33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.809792:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.809800:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853621.809811:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787853621.809930:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054f25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.809939:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054f25 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.809945:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054f25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.809957:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853621.809962:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054f25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.809970:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054f25 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.809984:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:3.0:1787853621.809987:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853621.809992:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054f25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.809998:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054f25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.810012:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.810018:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054f2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.810024:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054f2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.810029:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853621.810032:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054f2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.810038:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054f2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.810054:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff992742cddf00) 00010000:00010000:3.0:1787853621.810057:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853621.810060:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054f2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.810066:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054f2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.810235:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054f1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd209b expref: 33 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.810254:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054f33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd209b expref: 32 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.810262:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853621.810265:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853621.810267:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064cc00, rc 0) 00000100:00100000:3.0:1787853621.810424:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+32:10498:x1874700136396928:12345-192.168.206.10@tcp:101:cat.0 Request processed in 1572us (1863us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787853621.810434:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 94 00000100:00100000:1.0:1787853621.819410:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853621.819828:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136397184 00000100:00100000:3.0:1787853621.819908:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136397184 00000100:00100000:3.0:1787853621.819984:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 24 00000100:00100000:3.0:1787853621.819995:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c240f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+32:10498:x1874700136397184:12345-192.168.206.10@tcp:35:cat.0 00000100:00100000:3.0:1787853621.820845:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c240f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+33:10498:x1874700136397184:12345-192.168.206.10@tcp:35:cat.0 Request processed in 839us (1436us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787853621.820857:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 24 00000100:00100000:1.0:1787853621.857818:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853621.858549:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136397440 00000100:00100000:3.0:1787853621.858559:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136397440 00000100:00100000:3.0:1787853621.858618:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 95 00000100:00100000:3.0:1787853621.858627:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c243c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+33:10499:x1874700136397440:12345-192.168.206.10@tcp:36:rm.0 00010000:00010000:3.0:1787853621.858730:0:7618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787853621.858758:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb054f33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd209b expref: 33 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.858779:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb054f09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2094 expref: 32 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.858793:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ed1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2086 expref: 31 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.858803:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853621.858812:0:7618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787853621.858830:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054f41 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.858843:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054f41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.858851:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054f41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.858863:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054f48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.858870:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054f48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.858894:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054f48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.859197:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054f4f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.859206:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054f4f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.859213:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054f4f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787853621.859841:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1787853621.859853:0:7618:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 316157179169ns, next at 317157176449ns, rc = 0 00010000:00010000:3.0:1787853621.859910:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054f56 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.859920:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054f56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.859929:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054f56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.859935:0:7618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054f56 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.859942:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054f56 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.859947:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054f56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.859985:0:7618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787853621.860004:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054f4f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.860011:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054f4f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.860018:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054f4f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.860024:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064c200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853621.860029:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054f4f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.860037:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054f4f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.860049:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992742cdd300) 00010000:00010000:3.0:1787853621.860053:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787853621.860060:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054f4f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.860060:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853621.860082:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054f56 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.860083:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054f4f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.860111:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054f41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.860111:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d000 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853621.860121:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054f56 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.860126:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054f41 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.860145:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054f56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.860146:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054f41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.860173:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853621.860177:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054f41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.860184:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054f41 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.860194:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:3.0:1787853621.860196:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853621.860199:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054f41 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.860204:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054f41 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853621.860215:0:7618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e73a494 reply state 000000001c2cec8a transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054f48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853621.860223:0:7618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787853621.860303:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c243c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+32:10499:x1874700136397440:12345-192.168.206.10@tcp:36:rm.0 Request processed in 1675us (2490us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787853621.860311:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 95 00010000:00010000:0.0:1787853621.860339:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff992742cdd300) 00010000:00010000:0.0:1787853621.860345:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787853621.860366:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054f56 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.860373:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb054f56 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.860400:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853621.860402:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853621.860404:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853621.867822:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054f48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.867849:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054f48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.867858:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054f48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.867865:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853621.867871:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054f48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.867879:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054f48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.867902:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff992742cddf00) 00010000:00010000:0.0:1787853621.867906:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853621.867911:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054f48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.867923:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb054f48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853621.928839:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853621.928933:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136397696 00000100:00100000:2.0:1787853621.928946:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136397696 00000100:00100000:2.0:1787853621.929025:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 96 00000100:00100000:2.0:1787853621.929036:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+31:10505:x1874700136397696:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:2.0:1787853621.929065:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853621.929090:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054f5d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd20a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.929264:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054f64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.929299:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054f64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.929312:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054f64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.929328:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb054f6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.929334:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb054f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.929340:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb054f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787853621.930574:0:5825:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1787853621.932356:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054f72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.932383:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054f72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.932397:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054f72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.932457:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054f64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.932465:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054f64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.932474:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054f64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.932496:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853621.932501:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054f64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.932510:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054f64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.932525:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:2.0:1787853621.932529:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853621.932535:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054f64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.932542:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb054f64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787853621.932562:0:5825:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056e32c81 reply state 000000006d444fd7 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb054f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853621.932572:0:5825:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787853621.932617:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb054f5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20a2 expref: 34 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.932633:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054f72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20a2 expref: 33 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.932641:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992743be3400) 00010000:00010000:2.0:1787853621.932643:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853621.932646:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70400, rc 0) 00000100:00100000:2.0:1787853621.934376:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+34:10505:x1874700136397696:12345-192.168.206.10@tcp:101:bash.0 Request processed in 5326us (5534us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787853621.934405:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 96 00010000:00010000:0.0:1787853621.940101:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb054f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.940132:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb054f6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.940142:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb054f6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.940149:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853621.940155:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb054f6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.940170:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb054f6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.940192:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff992743be3800) 00010000:00010000:0.0:1787853621.940196:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853621.940201:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb054f6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853621.940209:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb054f6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853621.946379:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853621.950302:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136397824 00000100:00100000:2.0:1787853621.950322:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136397824 00000100:00100000:2.0:1787853621.950410:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:2.0:1787853621.950423:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136397824:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:2.0:1787853621.950448:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853621.950474:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005865485/0xcf1365f7cb054f80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd20a9 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787853621.950507:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853621.950532:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=316s v=(0 0) 00010000:00010000:2.0:1787853621.950537:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853621.950549:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005865485/0xcf1365f7cb054f80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20a9 expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.950574:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000005865485/0xcf1365f7cb054f80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20a9 expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.950590:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71a00, rc 0) 00000100:00100000:2.0:1787853621.950705:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2365:x1874700136397824:12345-192.168.206.10@tcp:101:bash.0 Request processed in 284us (4341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853621.950724:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:1.0:1787853621.960793:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853621.961008:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136397952 00000100:00100000:3.0:1787853621.961020:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136397952 00000100:00100000:3.0:1787853621.961138:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:3.0:1787853621.961149:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c2412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:10505:x1874700136397952:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787853621.961182:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853621.961206:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb054f87 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd20b0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.961274:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000005865485/0xcf1365f7cb054f80 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20a9 expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.961284:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853621.961288:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853621.961294:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb054f87 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20b0 expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.961332:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000005865485/0xcf1365f7cb054f80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20a9 expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.961348:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000005865485/0xcf1365f7cb054f80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20a9 expref: 7 pid: 6672 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853621.961364:0:6671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1874700152142976:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787853621.961494:0:6671:0:(client.c:2715:ptlrpc_set_wait()) set ffff992742d6d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853621.967362:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853621.967511:0:6671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1874700152142976:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787853621.967562:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb054f87 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20b0 expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853621.967589:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064d400, rc 0) 00000100:00100000:3.0:1787853621.967868:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c2412c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:10505:x1874700136397952:12345-192.168.206.10@tcp:101:bash.0 Request processed in 6718us (7086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853621.967878:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:2.0:1787853621.967930:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136398080 00000100:00100000:2.0:1787853621.967938:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136398080 00010000:00010000:2.0:1787853621.968051:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000005865485/0xcf1365f7cb054f80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20a9 expref: 7 pid: 6672 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853621.968281:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:2.0:1787853621.968293:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274415e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2364:x1874700136398080:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853621.968312:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853621.968352:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000005865485/0xcf1365f7cb054f80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20a9 expref: 7 pid: 6672 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.968369:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000005865485/0xcf1365f7cb054f80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20a9 expref: 7 pid: 6672 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.968396:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005865485/0xcf1365f7cb054f80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20a9 expref: 7 pid: 6672 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.968413:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853621.968418:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853621.968427:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb054f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20b0 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.968439:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb054f87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20b0 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853621.968481:0:5809:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb054f87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20b0 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853621.968498:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c24d2c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5809:1874700152143104:192.168.206.10@tcp:105: 00000100:00100000:2.0:1787853621.968582:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffff992766169600 going to sleep for 11 seconds 00000100:00100000:0.0:1787853621.974925:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853621.975099:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c24d2c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5809:1874700152143104:192.168.206.10@tcp:105: 00010000:00010000:2.0:1787853621.975134:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853621.975214:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136398336 00000100:00100000:2.0:1787853621.975221:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274415e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2364:x1874700136398080:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 6928us (7872us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853621.975224:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136398336 00000100:00100000:2.0:1787853621.975238:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:3.0:1787853621.975291:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:3.0:1787853621.975305:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+33:10505:x1874700136398336:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:3.0:1787853621.976267:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+34:10505:x1874700136398336:12345-192.168.206.10@tcp:35:bash.0 Request processed in 961us (1351us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787853621.976278:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:0.0:1787853622.086605:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c24da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152143232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853622.086758:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853622.087146:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152143232 00000100:00100000:3.0:1787853622.087158:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152143232 00000100:00100000:3.0:1787853622.087259:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787853622.087269:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1874700152143232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787853622.087315:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787853622.087395:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853622.087903:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1874700152143232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 634us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853622.087912:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787853622.088005:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c24da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152143232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853622.142645:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853622.144370:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136398464 00000100:00100000:1.0:1787853622.144388:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136398464 00000100:00100000:1.0:1787853622.144480:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 97 00000100:00100000:1.0:1787853622.144492:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+34:10521:x1874700136398464:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787853622.144525:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853622.144552:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb054f8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd20b7 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.144636:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb054f95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.144669:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb054f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.144710:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb054f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853622.144783:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787853622.144787:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853622.144815:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb054f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.144845:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb054f8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20b7 expref: 36 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.144868:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb054f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20b7 expref: 35 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.144877:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:1.0:1787853622.144880:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787853622.144884:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196200, rc 0) 00000100:00100000:1.0:1787853622.144977:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+35:10521:x1874700136398464:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 486us (2346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853622.144986:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 97 00010000:00010000:0.0:1787853622.150242:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853622.152315:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853622.152468:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136398720 00000100:00100000:3.0:1787853622.152481:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136398720 00000100:00100000:3.0:1787853622.152559:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 98 00000100:00100000:3.0:1787853622.152571:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c240b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+35:10521:x1874700136398720:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787853622.152598:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853622.152625:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054f9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd20be expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.152771:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054fa3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.152787:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.152819:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853622.152834:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787853622.152992:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054f9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20be expref: 38 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.153011:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20be expref: 37 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.153021:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992743be3400) 00010000:00010000:3.0:1787853622.153024:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853622.153029:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064dc00, rc 0) 00000100:00100000:3.0:1787853622.153111:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c240b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+37:10521:x1874700136398720:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 542us (808us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787853622.153182:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 98 00000100:00100000:2.0:1787853622.164908:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853622.164977:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853622.165066:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136398848 00000100:00100000:3.0:1787853622.165079:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136398848 00000100:00100000:3.0:1787853622.165152:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:3.0:1787853622.165184:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+37:2365:x1874700136398848:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853622.165205:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787853622.165210:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136399104 00000100:00100000:1.0:1787853622.165217:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136399104 00010000:00010000:3.0:1787853622.165247:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054fa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20be expref: 38 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853622.165266:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 99 00010000:00010000:3.0:1787853622.165271:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992743be3400) 00000100:00100000:1.0:1787853622.165278:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+37:10521:x1874700136399104:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787853622.165279:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853622.165322:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853622.165344:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb054fb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd20c5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853622.165375:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+38:2365:x1874700136398848:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 212us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853622.165384:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00010000:00010000:1.0:1787853622.165464:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb054fb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.165493:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb054fb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.165506:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb054fb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853622.165519:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787853622.165708:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb054fb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20c5 expref: 39 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.165726:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb054fb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20c5 expref: 38 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.165735:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992743be3400) 00010000:00010000:1.0:1787853622.165739:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787853622.165741:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766197a00, rc 0) 00000100:00100000:1.0:1787853622.165779:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+38:10521:x1874700136399104:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 505us (802us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1787853622.165786:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 99 00000100:00100000:2.0:1787853622.175625:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853622.179091:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136399232 00000100:00100000:1.0:1787853622.179111:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136399232 00000100:00100000:0.0:1787853622.179861:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:0.0:1787853622.179876:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2364:x1874700136399232:12345-192.168.206.10@tcp:1:lfs.0 00010000:00010000:0.0:1787853622.179933:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f764cebc/0xcf1365f7cb054fc6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.179958:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb054f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20b0 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.179969:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853622.179974:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787853622.179980:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f764cebc/0xcf1365f7cb054fc6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.180037:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb054f87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20b0 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.180053:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb054f87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20b0 expref: 6 pid: 6671 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853622.180070:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dc9cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6672:1874700152143360:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787853622.180231:0:6672:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927463b3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787853622.186505:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dc9cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6672:1874700152143360:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787853622.186545:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f764cebc/0xcf1365f7cb054fc6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853622.187988:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853622.188356:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136399360 00000100:00100000:3.0:1787853622.188367:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136399360 00002000:00100000:3.0:1787853622.188434:0:6678:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff99277c24e1c0 x1874700136399360/t0(0) o4->0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp:43/0 lens 504/0 e 0 to 0 dl 1787853633 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787853622.188448:0:6678:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99277c24e1c0 with x1874700136399360 ext(0->8) 00010000:00010000:3.0:1787853622.188458:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb054f87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20b0 expref: 7 pid: 6671 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.188476:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb054f87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20b0 expref: 7 pid: 6671 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787853622.188484:0:6678:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99277c24e1c0 00000100:00100000:3.0:1787853622.188655:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:3.0:1787853622.188666:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2364:x1874700136399360:12345-192.168.206.10@tcp:4:lfs.0 00000100:00100000:3.0:1787853622.189916:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:2364:x1874700136399360:12345-192.168.206.10@tcp:4:lfs.0 Request processed in 1241us (1927us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787853622.189930:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 1 00002000:00100000:3.0:1787853622.189943:0:6678:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff99277c24e1c0 x1874700136399360/t4294967302(0) o4->0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp:43/0 lens 504/448 e 0 to 0 dl 1787853633 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787853622.189953:0:6678:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99277c24e1c0 with x1874700136399360 ext(0->8) 00010000:00010000:3.0:1787853622.189964:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb054f87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20b0 expref: 9 pid: 6671 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.190000:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb054f87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20b0 expref: 9 pid: 6671 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787853622.190008:0:6678:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99277c24e1c0 00000100:00100000:0.0:1787853622.193945:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853622.194070:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136399488 00000100:00100000:3.0:1787853622.194082:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136399488 00010000:00010000:3.0:1787853622.194131:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb054f87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20b0 expref: 9 pid: 6671 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853622.194192:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:3.0:1787853622.194205:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:2364:x1874700136399488:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853622.194236:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787853622.194261:0:5811:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787853622.194264:0:5811:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787853621 00002000:00010000:3.0:1787853622.194266:0:5811:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787853622 00002000:00010000:3.0:1787853622.194268:0:5811:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787853621 00010000:00010000:3.0:1787853622.194275:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb054f87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20b0 expref: 9 pid: 6671 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.194290:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb054f87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20b0 expref: 9 pid: 6671 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.194331:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb054f87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20b0 expref: 9 pid: 6671 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.194377:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853622.194382:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853622.194390:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f764cebc/0xcf1365f7cb054fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.194403:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f764cebc/0xcf1365f7cb054fc6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.194443:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853622.194519:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2364:x1874700136399488:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 317us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853622.194528:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 50 00010000:00010000:0.0:1787853622.194607:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f764cebc/0xcf1365f7cb054fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.194618:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f764cebc/0xcf1365f7cb054fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.194659:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f764cebc/0xcf1365f7cb054fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.194720:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f764cebc/0xcf1365f7cb054fc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.194730:0:6672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f764cebc/0xcf1365f7cb054fc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.194737:0:6672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031000 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853622.194742:0:6672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f764cebc/0xcf1365f7cb054fc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.194753:0:6672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f764cebc/0xcf1365f7cb054fc6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.194766:0:6672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f764cebc/0xcf1365f7cb054fc6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.194773:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f764cebc/0xcf1365f7cb054fc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853622.194831:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2364:x1874700136399232:12345-192.168.206.10@tcp:1:lfs.0 Request processed in 14959us (19219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853622.194840:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:2.0:1787853622.200194:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853622.200278:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136399744 00000100:00100000:0.0:1787853622.200291:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136399744 00000100:00100000:0.0:1787853622.200362:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00100000:0.0:1787853622.200374:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274f704c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+38:10521:x1874700136399744:12345-192.168.206.10@tcp:35:lfs.0 00000004:00010000:0.0:1787853622.200459:0:5827:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb054fb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20c5 expref: 38 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787853622.201123:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1787853622.201189:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1787853622.201920:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1787853622.202000:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fcd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.202022:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054f72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20a2 expref: 42 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.202034:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fcd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.202077:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054f72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20a2 expref: 42 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.202096:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054f72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20a2 expref: 42 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853622.202112:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dc9d2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5827:1874700152143488:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787853622.202248:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927463b3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787853622.211058:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853622.211258:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136399872 00000100:00100000:3.0:1787853622.211269:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136399872 00010000:00010000:3.0:1787853622.211327:0:8433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054f72 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20a2 expref: 43 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853622.211377:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:3.0:1787853622.211387:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c242580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+43:2365:x1874700136399872:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853622.211405:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853622.211412:0:8433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054f72 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20a2 expref: 43 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.211428:0:8433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054f72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20a2 expref: 43 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.211468:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992743be3400) 00010000:00010000:3.0:1787853622.211474:0:8433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fcd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.211485:0:8433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.211502:0:8433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fcd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.211524:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853622.211589:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c242580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+43:2365:x1874700136399872:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 204us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853622.211597:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 51 00010000:00010000:0.0:1787853622.211908:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb054f72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20a2 expref: 42 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853622.211940:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dc9d2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5827:1874700152143488:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787853622.211965:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.211975:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.211982:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787853622.212123:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1787853622.212358:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1787853622.212471:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dc9d2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5827:1874700152143616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787853622.212885:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853622.212913:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927463b3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787853622.213644:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152143616 00000100:00100000:1.0:1787853622.213656:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152143616 00000100:00100000:1.0:1787853622.213775:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787853622.213787:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5827:x1874700152143616:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787853622.213887:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5827:x1874700152143616:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 103us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853622.213896:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787853622.214481:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853622.214601:0:5827:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1787853622.214609:0:5827:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1787853622.214722:0:5827:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff992761ea6940, transno 4294967301 00000100:00100000:0.0:1787853622.214893:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dc9d2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5827:1874700152143616:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787853622.215528:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1787853622.215625:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dc9d2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5827:1874700152143744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787853622.215736:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853622.217136:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927463b3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787853622.217473:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152143744 00000100:00100000:1.0:1787853622.217485:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152143744 00000100:00100000:1.0:1787853622.217570:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787853622.217582:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5827:x1874700152143744:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787853622.217974:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5827:x1874700152143744:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 394us (2237us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787853622.217984:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787853622.220788:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dc9d2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5827:1874700152143744:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787853622.220922:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1787853622.221014:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.221026:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fcd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.221034:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fcd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.221041:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853622.221046:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fcd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.221055:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fcd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.221073:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992743be3400) 00010000:00010000:0.0:1787853622.221076:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787853622.221082:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fcd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.221089:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fcd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787853622.222977:0:5827:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787853622.223110:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1787853622.223126:0:5827:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 316520452075ns, next at 317520448666ns, rc = 0 00000001:00080000:0.0:1787853622.223137:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1787853622.224969:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992743be3400) 00010000:00010000:0.0:1787853622.224982:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787853622.224996:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb054fb8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20c5 expref: 46 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853622.225232:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274f704c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+45:10521:x1874700136399744:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 24850us (25041us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1787853622.225244:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 26 00000020:00080000:0.0:1787853622.225252:0:5827:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787853622.232316:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853622.232474:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136400000 00000100:00100000:3.0:1787853622.232486:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136400000 00000100:00100000:3.0:1787853622.232577:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 100 00000100:00100000:3.0:1787853622.232591:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c2421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+45:10521:x1874700136400000:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787853622.232624:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853622.232667:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054fd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd20cc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.232774:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054fd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20cc expref: 46 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.232792:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054fd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20cc expref: 46 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.232841:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853622.232845:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787853622.232849:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064d400, rc 0) 00000100:00100000:3.0:1787853622.232929:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c2421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+46:10521:x1874700136400000:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 340us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853622.232937:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 100 00000100:00100000:2.0:1787853622.246040:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853622.247439:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136400256 00000100:00100000:3.0:1787853622.247456:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136400256 00000100:00100000:3.0:1787853622.247549:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:3.0:1787853622.247560:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+46:10521:x1874700136400256:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787853622.247923:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+47:10521:x1874700136400256:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 364us (1896us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1787853622.247932:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:1.0:1787853622.347569:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853622.347717:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136400384 00000100:00100000:0.0:1787853622.347730:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136400384 00000100:00100000:0.0:1787853622.347805:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 101 00000100:00100000:0.0:1787853622.347817:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c2430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+47:10531:x1874700136400384:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:0.0:1787853622.347915:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fdb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.347936:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.347951:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.347968:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054fe2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.347976:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.347983:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348102:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054fe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348131:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348138:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787853622.348315:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348331:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348338:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fdb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348345:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348352:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853622.348357:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348366:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fdb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348380:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:0.0:1787853622.348383:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853622.348388:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fdb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348395:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031800/0xcf1365f7cb054fdb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348417:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348423:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054fe2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348428:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054fe2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348433:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740031000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853622.348436:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054fe2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348443:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054fe2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348450:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff992761dc9100) 00010000:00010000:0.0:1787853622.348452:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853622.348455:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054fe2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348460:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb054fe2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348475:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348481:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348487:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348497:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992740030400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853622.348500:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348506:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348516:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:0.0:1787853622.348519:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853622.348522:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054fe9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.348527:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb054fe9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853622.348766:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c2430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+47:10531:x1874700136400384:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 948us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853622.348775:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 101 00000100:00100000:1.0:1787853622.398467:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853622.398595:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136400640 00000100:00100000:3.0:1787853622.398607:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136400640 00000100:00100000:3.0:1787853622.398722:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 102 00000100:00100000:3.0:1787853622.398735:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c243840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+47:10534:x1874700136400640:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787853622.398761:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853622.398788:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054ff0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd20d3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.398887:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ff7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.398905:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ff7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.398937:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ff7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.398956:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054ffe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.398964:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.398970:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.399131:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb055005 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.399141:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb055005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.399148:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb055005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853622.399158:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787853622.399297:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ff7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.399306:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ff7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.399313:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ff7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.399318:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064dc00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853622.399330:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ff7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.399338:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ff7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.399352:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:3.0:1787853622.399355:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853622.399360:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ff7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.399367:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb054ff7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.399383:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.399390:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054ffe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.399396:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054ffe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.399402:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064c600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853622.399405:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054ffe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.399412:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054ffe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.399419:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff992742cdd900) 00010000:00010000:3.0:1787853622.399421:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853622.399432:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054ffe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.399439:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb054ffe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.399487:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb054ff0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20d3 expref: 50 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.399502:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb055005 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20d3 expref: 49 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.399510:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853622.399513:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853622.399515:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064cc00, rc 0) 00000100:00100000:3.0:1787853622.399597:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c243840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+49:10534:x1874700136400640:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 866us (1146us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787853622.399605:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 102 00000100:00100000:3.0:1787853622.409632:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853622.410078:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136400768 00000100:00100000:2.0:1787853622.410090:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136400768 00000100:00100000:2.0:1787853622.410178:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 103 00000100:00100000:2.0:1787853622.410191:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+49:10534:x1874700136400768:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:2.0:1787853622.410641:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb055013 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.410663:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb055013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.410732:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb055013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.410781:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb055013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.410788:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb055013 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.410796:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb055013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.410802:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853622.410807:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb055013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.410815:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb055013 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.410830:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:2.0:1787853622.410834:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787853622.410839:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb055013 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.410846:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb055013 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853622.410946:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+49:10534:x1874700136400768:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 756us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853622.410955:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 103 00000100:00100000:1.0:1787853622.414336:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853622.414496:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136401024 00000100:00100000:3.0:1787853622.414507:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136401024 00000100:00100000:3.0:1787853622.414589:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:3.0:1787853622.414600:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c241680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+49:10534:x1874700136401024:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787853622.414935:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c241680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+50:10534:x1874700136401024:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 335us (610us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787853622.414943:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:1.0:1787853622.475034:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853622.475227:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136401280 00000100:00100000:3.0:1787853622.475239:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136401280 00000100:00100000:3.0:1787853622.475464:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 104 00000100:00100000:3.0:1787853622.475475:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c242d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+50:10544:x1874700136401280:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787853622.475503:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853622.475506:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787853622.475539:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb054f95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20b7 expref: 50 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.475562:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:3.0:1787853622.475567:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787853622.475583:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb05501a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd20da expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.475766:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb055021 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.475782:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb055005 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20d3 expref: 50 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.475791:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb055021 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.475828:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb055005 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20d3 expref: 50 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.475843:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb055005 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20d3 expref: 50 pid: 5826 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853622.475888:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5826:1874700152143872:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787853622.476026:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff992742d6d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853622.483334:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5826:1874700152143872:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787853622.483374:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb055021 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853622.486353:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853622.486607:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136401408 00000100:00100000:3.0:1787853622.486620:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136401408 00010000:00010000:3.0:1787853622.486711:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb055005 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20d3 expref: 51 pid: 5826 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853622.486981:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:3.0:1787853622.486993:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c241e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+51:2364:x1874700136401408:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853622.487012:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853622.487021:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb055005 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20d3 expref: 51 pid: 5826 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.487038:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb055005 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20d3 expref: 51 pid: 5826 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.487067:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb055005 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20d3 expref: 51 pid: 5826 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.487096:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853622.487102:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb055021 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.487113:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb055021 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.487155:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb055021 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.487207:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853622.487258:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb055021 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.487269:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb055021 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853622.487292:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c241e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+50:2364:x1874700136401408:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 300us (950us total) trans 0 rc 0/0 00000004:00200000:1.0:1787853622.487293:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:3.0:1787853622.487304:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 52 00010000:00010000:1.0:1787853622.488093:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb05501a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20da expref: 51 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.488533:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb055021 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20da expref: 50 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.488550:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:1.0:1787853622.488553:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787853622.488556:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064c600, rc 0) 00000100:00100000:1.0:1787853622.488699:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c242d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+50:10544:x1874700136401280:12345-192.168.206.10@tcp:101:bash.0 Request processed in 13201us (13652us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1787853622.488708:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 104 00000100:00100000:1.0:1787853622.494816:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853622.494974:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136401664 00000100:00100000:2.0:1787853622.494986:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136401664 00000100:00100000:2.0:1787853622.496667:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 105 00000100:00100000:2.0:1787853622.496728:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c240780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+50:10544:x1874700136401664:12345-192.168.206.10@tcp:36:bash.0 00010000:00010000:2.0:1787853622.497110:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05502f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.497130:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05502f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.497143:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05502f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787853622.497211:0:7618:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1787853622.497239:0:7618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b158f28 reply state 0000000076b3ea75 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05502f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853622.497249:0:7618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787853622.497364:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c240780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+53:10544:x1874700136401664:12345-192.168.206.10@tcp:36:bash.0 Request processed in 641us (2560us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787853622.497372:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 105 00000020:00080000:2.0:1787853622.497378:0:7618:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787853622.499612:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05502f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.499632:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05502f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.499641:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05502f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.499647:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853622.499652:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05502f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.499707:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05502f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.499728:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:0.0:1787853622.499731:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853622.499736:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05502f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.499742:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05502f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853622.502906:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853622.503012:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136401792 00000100:00100000:0.0:1787853622.503024:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136401792 00000100:00100000:0.0:1787853622.503122:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 106 00000100:00100000:0.0:1787853622.503132:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c2403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+52:10544:x1874700136401792:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787853622.503175:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853622.503204:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb055036 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd20e1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.503402:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb05503d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.503419:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb055021 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20da expref: 53 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.503429:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb05503d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.503466:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb055021 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20da expref: 53 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.503495:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb055021 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20da expref: 53 pid: 5826 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853622.503512:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dc9e580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5825:1874700152144000:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787853622.503688:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927463b33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853622.506937:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853622.508429:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dc9e580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5825:1874700152144000:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787853622.508432:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136401920 00000100:00100000:3.0:1787853622.508442:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136401920 00010000:00010000:2.0:1787853622.508471:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb05503d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.508492:0:8433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb055021 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20da expref: 54 pid: 5826 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853622.508541:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:3.0:1787853622.508551:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775481a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+54:2364:x1874700136401920:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853622.508569:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853622.508577:0:8433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb055021 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20da expref: 54 pid: 5826 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.508591:0:8433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb055021 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20da expref: 54 pid: 5826 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.508618:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb055021 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20da expref: 54 pid: 5826 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.508636:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853622.508641:0:8433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb05503d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.508705:0:8433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb05503d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.508715:0:8433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb05503d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.508746:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853622.508825:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775481a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+53:2364:x1874700136401920:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 274us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853622.508834:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 53 00010000:00010000:2.0:1787853622.510129:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb05503d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.510144:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb05503d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853622.510358:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787853622.510376:0:5825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853622.510462:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb05503d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.510506:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740030400/0xcf1365f7cb055036 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20e1 expref: 53 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.510527:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb05503d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20e1 expref: 52 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.510536:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:2.0:1787853622.510539:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853622.510542:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992740031000, rc 0) 00000100:00100000:2.0:1787853622.510645:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c2403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+52:10544:x1874700136401792:12345-192.168.206.10@tcp:101:bash.0 Request processed in 7513us (7753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853622.510654:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 106 00000100:00100000:0.0:1787853622.514451:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853622.514605:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136402176 00000100:00100000:3.0:1787853622.514617:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136402176 00000100:00100000:3.0:1787853622.514727:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:3.0:1787853622.514738:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775483c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+52:10544:x1874700136402176:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:3.0:1787853622.515052:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775483c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+53:10544:x1874700136402176:12345-192.168.206.10@tcp:35:bash.0 Request processed in 315us (614us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1787853622.515061:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:0.0:1787853622.588901:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853622.589403:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136402304 00000100:00100000:3.0:1787853622.589415:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136402304 00000100:00100000:3.0:1787853622.589634:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 107 00000100:00100000:3.0:1787853622.589648:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+53:10550:x1874700136402304:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787853622.589724:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853622.589752:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb055044 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd20e8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.589971:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb05504b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.590005:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb05504b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.590018:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb05504b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853622.590099:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787853622.590103:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853622.590127:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb05504b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.590156:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb055044 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20e8 expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.590193:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb05504b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20e8 expref: 54 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.590202:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:3.0:1787853622.590206:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787853622.590210:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064cc00, rc 0) 00000100:00100000:3.0:1787853622.590281:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+54:10550:x1874700136402304:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 636us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853622.590289:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 107 00000100:00100000:1.0:1787853622.592850:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853622.592986:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136402432 00000100:00100000:2.0:1787853622.592998:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136402432 00000100:00100000:2.0:1787853622.593066:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 108 00000100:00100000:2.0:1787853622.593078:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c240f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+54:10550:x1874700136402432:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787853622.593103:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853622.593131:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055052 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd20ef expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.593232:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055059 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.593249:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055059 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.593285:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055059 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.593303:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055060 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.593311:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.593318:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.593565:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb055067 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.593575:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb055067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.593582:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb055067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853622.594109:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787853622.594115:0:5826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853622.594142:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb055067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.595558:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb055067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.595583:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055059 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.595632:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055059 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.595641:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055059 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.595647:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853622.595652:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055059 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.595661:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055059 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.595693:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:2.0:1787853622.595697:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853622.595702:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055059 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.595710:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055059 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.595728:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.595734:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055060 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.595740:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.595745:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853622.596108:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.596118:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055060 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.596129:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff992743be3000) 00010000:00010000:2.0:1787853622.596132:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853622.596136:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055060 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.596142:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055060 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.596269:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055052 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20ef expref: 56 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.596287:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb055067 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20ef expref: 55 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.596295:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:2.0:1787853622.596298:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853622.596301:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71a00, rc 0) 00000100:00100000:2.0:1787853622.596406:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c240f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+55:10550:x1874700136402432:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 3328us (3566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853622.596417:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 108 00000100:00100000:0.0:1787853622.601780:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853622.602611:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853622.602725:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136402816 00000100:00100000:3.0:1787853622.602748:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136402816 00000100:00100000:3.0:1787853622.602821:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:3.0:1787853622.602832:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c241a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+55:2362:x1874700136402816:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853622.602852:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853622.602902:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb055067 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20ef expref: 55 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.602925:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853622.602931:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853622.603003:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c241a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+54:2362:x1874700136402816:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 173us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853622.603012:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:2.0:1787853622.604083:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136402688 00000100:00100000:2.0:1787853622.604094:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136402688 00000100:00100000:2.0:1787853622.604155:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 109 00000100:00100000:2.0:1787853622.604235:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+54:10550:x1874700136402688:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787853622.604269:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853622.604292:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb05506e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd20f6 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.604418:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb055075 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.604435:0:7618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb05503d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20e1 expref: 55 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.604445:0:7618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb055075 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.604485:0:7618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb05503d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20e1 expref: 55 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.604502:0:7618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb05503d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20e1 expref: 55 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853622.604518:0:7618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c24f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7618:1874700152144128:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787853622.605721:0:7618:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c096480 going to sleep for 11 seconds 00000100:00100000:2.0:1787853622.609342:0:7618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c24f840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7618:1874700152144128:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787853622.609383:0:7618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb055075 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853622.609464:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853622.609627:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136402944 00000100:00100000:3.0:1787853622.609635:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136402944 00010000:00010000:3.0:1787853622.609711:0:8433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb05503d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20e1 expref: 56 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853622.609753:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 54 00000100:00100000:3.0:1787853622.609883:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274415c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+56:2364:x1874700136402944:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853622.609902:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853622.609910:0:8433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb05503d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20e1 expref: 56 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.609924:0:8433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb05503d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20e1 expref: 56 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.609951:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031000/0xcf1365f7cb05503d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20e1 expref: 56 pid: 5825 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.609970:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853622.609976:0:8433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb055075 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.610002:0:8433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb055075 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.610012:0:8433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb055075 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.610043:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853622.610115:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274415c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+55:2364:x1874700136402944:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 234us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853622.610124:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 54 00010000:00010000:2.0:1787853622.610151:0:7618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb055075 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.610171:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb055075 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853622.610268:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787853622.611008:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb05506e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20f6 expref: 57 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.611028:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb055075 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20f6 expref: 55 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.611035:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:2.0:1787853622.611038:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787853622.611042:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71000, rc 0) 00000100:00100000:2.0:1787853622.611078:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+55:10550:x1874700136402688:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 6848us (9319us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1787853622.611086:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 109 00000100:00100000:1.0:1787853622.617338:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853622.617629:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136403200 00000100:00100000:3.0:1787853622.617642:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136403200 00000100:00100000:3.0:1787853622.617747:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:3.0:1787853622.617770:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c242580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+55:10550:x1874700136403200:12345-192.168.206.10@tcp:103:lfs.0 00010000:00010000:3.0:1787853622.617788:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853622.617828:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb054fd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20cc expref: 55 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.617853:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853622.617858:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853622.617932:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c242580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+54:10550:x1874700136403200:12345-192.168.206.10@tcp:103:lfs.0 Request processed in 175us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853622.617940:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:0.0:1787853622.621008:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853622.621563:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136403328 00000100:00100000:2.0:1787853622.621576:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136403328 00000100:00100000:2.0:1787853622.621714:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 110 00000100:00100000:2.0:1787853622.621727:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+54:10550:x1874700136403328:12345-192.168.206.10@tcp:58:lfs.0 00010000:00010000:2.0:1787853622.621860:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055083 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.621880:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055083 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.621893:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055083 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787853622.622151:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787853622.623668:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+54:10550:x1874700136403328:12345-192.168.206.10@tcp:58:lfs.0 Request processed in 1930us (2992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853622.623694:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 110 00000100:00100000:1.0:1787853622.626540:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853622.626650:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136403456 00000100:00100000:3.0:1787853622.626662:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136403456 00000100:00100000:3.0:1787853622.626932:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 111 00000100:00100000:3.0:1787853622.626944:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c241e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+54:10550:x1874700136403456:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787853622.626990:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853622.627016:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb05508a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd20fd expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.627090:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055083 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.627101:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb05508a lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20fd expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.627123:0:5824:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055083 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.627263:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb05508a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20fd expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.627280:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853622.627284:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787853622.627288:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb05508a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20fd expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853622.627296:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064c600, rc 0) 00000100:00100000:3.0:1787853622.627612:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c241e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+55:10550:x1874700136403456:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 669us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853622.627619:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 111 00000040:00080000:2.0:1787853622.918943:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787853622.918956:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787853622.919034:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787853622.919042:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787853622.921605:0:11666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874700152144256:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787853622.921864:0:11666:0:(client.c:2715:ptlrpc_set_wait()) set ffff992742d6d480 going to sleep for 11 seconds 00000100:00100000:1.0:1787853622.925986:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853622.926866:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136403584 00000100:00100000:2.0:1787853622.926880:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136403584 00000100:00100000:2.0:1787853622.927123:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 112 00000100:00100000:2.0:1787853622.927135:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c241a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+56:10551:x1874700136403584:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787853622.927191:0:5826:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787853622.927452:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c241a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+56:10551:x1874700136403584:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 318us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853622.927461:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 112 00000100:00100000:3.0:1787853622.927872:0:11666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874700152144256:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787853622.932565:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853622.932821:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136403712 00000100:00100000:2.0:1787853622.932835:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136403712 00000100:00100000:2.0:1787853622.932912:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 113 00000100:00100000:2.0:1787853622.932934:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748f5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+55:10551:x1874700136403712:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787853622.933055:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055091 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933077:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055091 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933094:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055091 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933112:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055098 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933135:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055098 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933143:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055098 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933183:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb05509f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933192:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb05509f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933200:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb05509f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853622.933248:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787853622.933253:0:7618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853622.933270:0:7618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb05509f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933282:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055091 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933289:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055091 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933296:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055091 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933303:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853622.933308:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055091 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933325:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055091 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933339:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff992761dc9700) 00010000:00010000:2.0:1787853622.933343:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853622.933348:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055091 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933355:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055091 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933372:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055098 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933377:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055098 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933383:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055098 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933389:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853622.933392:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055098 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933398:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055098 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933404:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff992743be3000) 00010000:00010000:2.0:1787853622.933407:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853622.933410:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055098 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933427:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055098 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933445:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb05509f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933452:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb05509f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933458:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb05509f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933463:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853622.933466:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb05509f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933472:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb05509f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933481:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:2.0:1787853622.933483:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853622.933487:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb05509f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.933493:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb05509f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853622.933592:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748f5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+55:10551:x1874700136403712:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 Request processed in 659us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853622.933600:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 113 00000100:00100000:1.0:1787853622.938622:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853622.941629:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136403968 00000100:00100000:2.0:1787853622.941654:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136403968 00000100:00100000:2.0:1787853622.941800:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 114 00000100:00100000:2.0:1787853622.941813:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277526de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+55:10551:x1874700136403968:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853622.941844:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853622.941875:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb0550a6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2104 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.942661:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0550ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.943078:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0550ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.943094:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0550ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853622.943110:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787853622.943262:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0550ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.943271:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0550ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.943279:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0550ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.943285:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853622.943289:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0550ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.943298:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0550ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.943328:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:2.0:1787853622.943331:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787853622.943336:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0550ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.943343:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0550ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.943400:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb0550a6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2104 expref: 57 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.943412:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff992761dc9700) 00010000:00010000:2.0:1787853622.943414:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787853622.943419:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb0550a6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2104 expref: 57 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.943428:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71e00, rc 0) 00000100:00100000:2.0:1787853622.943532:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277526de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+56:10551:x1874700136403968:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 1721us (4924us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787853622.943542:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 114 00000100:00100000:1.0:1787853622.952578:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853622.952841:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136404096 00000100:00100000:2.0:1787853622.952856:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136404096 00000100:00100000:2.0:1787853622.953044:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 115 00000100:00100000:2.0:1787853622.953059:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277526c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+56:10551:x1874700136404096:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787853622.953106:0:7618:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787853622.953354:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277526c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+56:10551:x1874700136404096:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 293us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853622.953381:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 115 00000100:00100000:1.0:1787853622.958636:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853622.958815:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136404352 00000100:00100000:0.0:1787853622.958828:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136404352 00000100:00100000:0.0:1787853622.958904:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 116 00000100:00100000:0.0:1787853622.958914:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277526e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+56:10551:x1874700136404352:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853622.958947:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853622.958951:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787853622.959057:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb05504b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20e8 expref: 56 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.959083:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:0.0:1787853622.959090:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853622.959109:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0550bb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd210b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787853622.959637:0:5825:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787853622.962275:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0550c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.962475:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0550c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853622.962493:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0550c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.971147:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0550bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd210b expref: 58 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.971200:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0550c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd210b expref: 57 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.971235:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff992761dc9100) 00010000:00010000:1.0:1787853622.971239:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787853622.971244:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a9a00, rc 0) 00000100:00100000:1.0:1787853622.971342:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277526e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+57:10551:x1874700136404352:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 12428us (12718us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787853622.971352:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 116 00000100:00100000:1.0:1787853622.981458:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853622.982261:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136404608 00000100:00100000:1.0:1787853622.982570:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136404608 00000100:00100000:1.0:1787853622.982755:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 117 00000100:00100000:1.0:1787853622.982769:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277526da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+57:10551:x1874700136404608:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787853622.982842:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853622.982885:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0550c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd210b expref: 57 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.982908:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff992761dc9100) 00010000:00010000:1.0:1787853622.982921:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853622.982945:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb0550d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.982962:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb0550d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.982973:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb0550d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.982990:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb0550d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb2c025cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.983014:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb0550d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb2c025cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.983021:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb0550d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb2c025cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.983132:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb0550d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.983142:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb0550d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.983150:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb0550d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.983167:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853622.983172:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb0550d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.983180:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb0550d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.983189:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:1.0:1787853622.983192:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853622.983196:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb0550d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.983203:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb0550d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.983213:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb0550d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb2c025cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.983228:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb0550d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb2c025cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.983234:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb0550d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb2c025cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.983239:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853622.983242:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb0550d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb2c025cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.983248:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb0550d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb2c025cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.983255:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb2c025cc (ffff9927433f1400) 00010000:00010000:1.0:1787853622.983257:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853622.983260:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb0550d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb2c025cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853622.983266:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb0550d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb2c025cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853622.983378:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277526da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+56:10551:x1874700136404608:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 611us (1933us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787853622.983386:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 117 00000100:00100000:0.0:1787853622.987299:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853622.988583:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136404736 00000100:00100000:2.0:1787853622.988602:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136404736 00000100:00100000:2.0:1787853622.988718:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 118 00000100:00100000:2.0:1787853622.988730:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+56:10551:x1874700136404736:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853622.988776:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853622.988805:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb0550de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2112 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.988859:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0550e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.989138:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0550e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.989168:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0550e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.989300:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb0550de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2112 expref: 58 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.989325:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0550e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2112 expref: 57 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.989334:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff992743be3000) 00010000:00010000:2.0:1787853622.989338:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787853622.989342:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70400, rc 0) 00000100:00100000:2.0:1787853622.989429:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+57:10551:x1874700136404736:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 702us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853622.989445:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 118 00000100:00100000:0.0:1787853622.994496:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853622.994638:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136404992 00000100:00100000:2.0:1787853622.994652:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136404992 00000100:00100000:2.0:1787853622.994750:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 119 00000100:00100000:2.0:1787853622.994761:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+57:10551:x1874700136404992:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787853622.994946:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0550ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.994967:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0550ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853622.994983:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0550ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787853622.995290:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1787853622.995301:0:7618:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 317292626974ns, next at 318292624255ns, rc = 0 00000004:00010000:2.0:1787853622.995400:0:7618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbcb1ec8 reply state 00000000728a4f9d transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0550ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853622.995411:0:7618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787853622.996249:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+59:10551:x1874700136404992:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 1482us (1760us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1787853622.996259:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 119 00010000:00010000:0.0:1787853623.001092:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0550ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.001116:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0550ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.001135:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0550ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.001142:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853623.001148:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0550ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.001171:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0550ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.001193:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff992743be3000) 00010000:00010000:0.0:1787853623.001196:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787853623.001222:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0550ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.001230:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0550ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853623.003414:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853623.004086:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136405120 00000100:00100000:1.0:1787853623.004099:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136405120 00000100:00100000:1.0:1787853623.004218:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 120 00000100:00100000:1.0:1787853623.004230:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+58:10551:x1874700136405120:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853623.004260:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853623.004299:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb0550f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2119 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.004377:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb0550f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2119 expref: 59 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.004394:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb0550f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2119 expref: 59 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.004416:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff992743be3000) 00010000:00010000:1.0:1787853623.004420:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787853623.004424:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196e00, rc 0) 00000100:00100000:1.0:1787853623.004503:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+59:10551:x1874700136405120:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 276us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853623.004663:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 120 00000100:00080000:0.0:1787853623.005361:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853623.010112:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853623.010348:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136405248 00000100:00100000:1.0:1787853623.010361:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136405248 00000100:00100000:1.0:1787853623.010445:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:1.0:1787853623.010456:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2365:x1874700136405248:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787853623.010873:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:2365:x1874700136405248:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 417us (773us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787853623.010881:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00080000:0.0:1787853623.011173:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853623.015286:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853623.015429:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136405504 00000100:00100000:3.0:1787853623.015441:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136405504 00000100:00100000:3.0:1787853623.015520:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 30 00000100:00100000:3.0:1787853623.015532:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+59:10551:x1874700136405504:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787853623.015870:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+60:10551:x1874700136405504:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 339us (606us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1787853623.015879:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 30 00000100:00100000:2.0:1787853623.019972:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853623.020385:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136405760 00000100:00100000:0.0:1787853623.020408:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136405760 00000100:00100000:0.0:1787853623.020482:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 121 00000100:00100000:0.0:1787853623.020494:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+60:10551:x1874700136405760:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787853623.020655:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+60:10551:x1874700136405760:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 164us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853623.020663:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 121 00000100:00100000:2.0:1787853623.025132:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853623.025498:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136405888 00000100:00100000:1.0:1787853623.025517:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136405888 00000100:00100000:1.0:1787853623.025594:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 122 00000100:00100000:1.0:1787853623.025606:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+60:10551:x1874700136405888:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853623.025630:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853623.025716:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb0550fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2120 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.025810:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055101 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.025826:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.025850:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853623.026267:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853623.026297:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.026330:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb0550fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2120 expref: 62 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.026354:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055101 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2120 expref: 61 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.026364:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff992743be3000) 00010000:00010000:1.0:1787853623.026367:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787853623.026371:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196000, rc 0) 00000100:00100000:1.0:1787853623.026733:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+61:10551:x1874700136405888:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 1127us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853623.026742:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 122 00000100:00100000:1.0:1787853623.032789:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853623.033346:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136406016 00000100:00100000:3.0:1787853623.033358:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136406016 00000100:00100000:3.0:1787853623.033479:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:3.0:1787853623.033491:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277526c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:2364:x1874700136406016:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787853623.033524:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853623.033550:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b163a7d2/0xcf1365f7cb055108 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2127 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787853623.033582:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a907b36, blocks: 0x1 00010000:00010000:3.0:1787853623.033606:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=317s v=(0 0) 00010000:00010000:3.0:1787853623.033611:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853623.033623:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b163a7d2/0xcf1365f7cb055108 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2127 expref: 10 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.033646:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b163a7d2/0xcf1365f7cb055108 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2127 expref: 10 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.033662:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064d400, rc 0) 00000100:00100000:3.0:1787853623.034021:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277526c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+10:2364:x1874700136406016:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 531us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853623.034037:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:2.0:1787853623.038431:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853623.038624:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136406272 00000100:00100000:0.0:1787853623.038635:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136406272 00000100:00100000:0.0:1787853623.038779:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 123 00000100:00100000:0.0:1787853623.038792:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+61:10551:x1874700136406272:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787853623.039118:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+61:10551:x1874700136406272:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 328us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853623.039251:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 123 00000100:00100000:1.0:1787853623.042461:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853623.042703:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136406400 00000100:00100000:3.0:1787853623.042715:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136406400 00000100:00100000:3.0:1787853623.042787:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:3.0:1787853623.042810:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277526cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+10:10551:x1874700136406400:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787853623.042835:0:11669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853623.042859:0:11669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001eb466e0/0xcf1365f7cb05510f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd212e expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.042900:0:11669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b163a7d2/0xcf1365f7cb055108 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2127 expref: 11 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.042911:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853623.042915:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853623.042922:0:11669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eb466e0/0xcf1365f7cb05510f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd212e expref: 11 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.042963:0:11669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b163a7d2/0xcf1365f7cb055108 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2127 expref: 11 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.042980:0:11669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b163a7d2/0xcf1365f7cb055108 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2127 expref: 11 pid: 6673 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853623.042995:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11669:1874700152144384:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787853623.043116:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff992742d6d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787853623.045354:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11669:1874700152144384:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787853623.045398:0:11669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001eb466e0/0xcf1365f7cb05510f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd212e expref: 11 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.045426:0:11669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064d200, rc 0) 00000100:00100000:3.0:1787853623.045531:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277526cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+11:10551:x1874700136406400:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 2734us (3083us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853623.045542:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:2.0:1787853623.046328:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853623.047202:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136406528 00000100:00100000:0.0:1787853623.047215:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136406528 00010000:00010000:0.0:1787853623.047271:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b163a7d2/0xcf1365f7cb055108 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2127 expref: 11 pid: 6673 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853623.047343:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 55 00000100:00100000:0.0:1787853623.047354:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+11:2365:x1874700136406528:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853623.047372:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853623.047403:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b163a7d2/0xcf1365f7cb055108 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2127 expref: 11 pid: 6673 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.047419:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b163a7d2/0xcf1365f7cb055108 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2127 expref: 11 pid: 6673 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.047449:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b163a7d2/0xcf1365f7cb055108 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2127 expref: 11 pid: 6673 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.047469:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853623.047474:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853623.047483:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001eb466e0/0xcf1365f7cb05510f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd212e expref: 10 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.047494:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001eb466e0/0xcf1365f7cb05510f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd212e expref: 10 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.048368:0:5810:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001eb466e0/0xcf1365f7cb05510f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd212e expref: 10 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853623.048394:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277526fc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5810:1874700152144512:192.168.206.10@tcp:105: 00000100:00100000:1.0:1787853623.048551:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277bf44e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787853623.055853:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853623.056052:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136406656 00000100:00100000:3.0:1787853623.056064:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136406656 00002000:00100000:3.0:1787853623.056203:0:6676:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff99277526f480 x1874700136406656/t0(0) o4->0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp:44/0 lens 504/0 e 0 to 0 dl 1787853634 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787853623.056216:0:6676:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99277526f480 with x1874700136406656 ext(0->12) 00002000:00010000:3.0:1787853623.056223:0:6676:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99277526f480 00000100:00100000:2.0:1787853623.056356:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277526fc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5810:1874700152144512:192.168.206.10@tcp:105: 00010000:00010000:2.0:1787853623.056385:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853623.056475:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+11:2365:x1874700136406528:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 9121us (10152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853623.056486:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 55 00000100:00100000:3.0:1787853623.057094:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:3.0:1787853623.057106:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277526f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+10:2365:x1874700136406656:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787853623.058221:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277526f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+12:2365:x1874700136406656:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 Request processed in 1110us (2375us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787853623.058233:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00002000:00100000:3.0:1787853623.058244:0:6676:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff99277526f480 x1874700136406656/t4294967308(0) o4->0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp:44/0 lens 504/448 e 0 to 0 dl 1787853634 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787853623.058254:0:6676:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99277526f480 with x1874700136406656 ext(0->12) 00002000:00010000:3.0:1787853623.058260:0:6676:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99277526f480 00000100:00100000:1.0:1787853623.060631:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853623.060748:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136406784 00000100:00100000:3.0:1787853623.060760:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136406784 00000100:00100000:3.0:1787853623.060888:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 124 00000100:00100000:3.0:1787853623.060900:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277526c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+61:10551:x1874700136406784:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787853623.090359:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000004:00080000:2.0:1787853623.090383:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1787853623.090407:0:5846:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9927463b3a80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1787853623.090413:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99277be38600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9927463b3840 00000020:00080000:2.0:1787853623.090417:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99277be38400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99276de01400 00000020:00080000:2.0:1787853623.090452:0:5846:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9927609456c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1787853623.090456:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99275018b500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff992760945e40 00000020:00080000:2.0:1787853623.090459:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff992748367b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99277c784400 00000001:00080000:2.0:1787853623.090474:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:2.0:1787853623.090476:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:2.0:1787853623.090514:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1787853623.090535:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787853623.090562:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787853623.090792:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787853623.090946:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c24c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152144640:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787853623.091027:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853623.091086:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c24da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152144768:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787853623.091111:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853623.091147:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152144640 00000100:00100000:3.0:1787853623.091544:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277526c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:10551:x1874700136406784:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 Request processed in 30641us (30921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853623.091557:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 124 00000100:00100000:2.0:1787853623.092080:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152144640 00000100:00100000:2.0:1787853623.092184:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152144768 00000100:00100000:2.0:1787853623.092188:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152144768 00000100:00100000:1.0:1787853623.092306:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787853623.092320:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3298:x1874700152144640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787853623.092352:0:6671:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1787853623.092386:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059e31d64/0xcf1365f7cb055116 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.092408:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000034748a21/0xcf1365f7cb054ed8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd208d expref: 11 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.092417:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787853623.092423:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787853623.092427:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059e31d64/0xcf1365f7cb055116 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.092461:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000034748a21/0xcf1365f7cb054ed8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd208d expref: 11 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.092477:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000034748a21/0xcf1365f7cb054ed8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd208d expref: 11 pid: 6672 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853623.092509:0:6671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277526d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6671:1874700152145024:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787853623.092589:0:6671:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c218a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787853623.092978:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787853623.092990:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3299:x1874700152144768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787853623.093285:0:6672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787853623.093289:0:6672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787853623 00002000:00010000:2.0:1787853623.093291:0:6672:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787853623.093293:0:6672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787853622 -> 1787853623 00002000:00010000:2.0:1787853623.093296:0:6672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787853623.093354:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3299:x1874700152144768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 367us (2242us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787853623.093362:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:2.0:1787853623.093419:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99277c24da40/2, rc 0, transno 4294967309 00000100:00100000:2.0:1787853623.093426:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c24da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152144768:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787853623.093439:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787853623.093448:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152144896:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787853623.093480:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853623.093599:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152144896 00000100:00100000:3.0:1787853623.093605:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152144896 00000100:00100000:3.0:1787853623.093642:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787853623.093650:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277512e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1874700152144896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787853623.093668:0:6673:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1787853623.093712:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a907b35, atime: 0x6a907b36, ctime: 0x6a907b35, blocks: 0x1 00010000:00010000:3.0:1787853623.093720:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009592ade5/0xcf1365f7cb05511d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.093734:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=317s v=(0 0) 00010000:00010000:3.0:1787853623.093738:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853623.093745:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009592ade5/0xcf1365f7cb05511d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.093762:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009592ade5/0xcf1365f7cb05511d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.093774:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009592ade5/0xcf1365f7cb05511d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.093802:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009592ade5/0xcf1365f7cb05511d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.093908:0:6673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787853623.094466:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277512e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3299:x1874700152144896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 814us (983us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787853623.094475:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:2.0:1787853623.094702:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99277c3b4f00/2, rc 0, transno 4294967304 00000100:00100000:2.0:1787853623.094709:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152144896:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787853623.094927:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853623.094937:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009592ade5/0xcf1365f7cb05511d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.094967:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d000 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853623.094972:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009592ade5/0xcf1365f7cb05511d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.094982:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009592ade5/0xcf1365f7cb05511d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.095005:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009592ade5/0xcf1365f7cb05511d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.095012:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009592ade5/0xcf1365f7cb05511d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.095035:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853623.095037:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853623.095039:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853623.096550:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853623.096781:0:6671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277526d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6671:1874700152145024:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787853623.096815:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000059e31d64/0xcf1365f7cb055116 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853623.096933:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136406912 00000100:00100000:2.0:1787853623.096941:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136406912 00010000:00010000:2.0:1787853623.096987:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000034748a21/0xcf1365f7cb054ed8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd208d expref: 12 pid: 6672 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853623.097066:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 56 00000100:00100000:2.0:1787853623.097078:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277526cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+12:2364:x1874700136406912:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853623.097113:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853623.097120:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000034748a21/0xcf1365f7cb054ed8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd208d expref: 12 pid: 6672 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.097134:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000034748a21/0xcf1365f7cb054ed8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd208d expref: 12 pid: 6672 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.097181:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034748a21/0xcf1365f7cb054ed8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd208d expref: 12 pid: 6672 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.097201:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787853623.097206:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787853623.097212:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000059e31d64/0xcf1365f7cb055116 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.097222:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059e31d64/0xcf1365f7cb055116 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.097252:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853623.097324:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277526cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+11:2364:x1874700136406912:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 248us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853623.097333:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 56 00010000:00010000:3.0:1787853623.097702:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000059e31d64/0xcf1365f7cb055116 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.097712:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059e31d64/0xcf1365f7cb055116 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.097724:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059e31d64/0xcf1365f7cb055116 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.097732:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059e31d64/0xcf1365f7cb055116 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.097765:0:6671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787853623.098789:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3298:x1874700152144640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6469us (7758us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787853623.098802:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1787853623.099227:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853623.099238:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059e31d64/0xcf1365f7cb055116 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.099250:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197600 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:1.0:1787853623.099255:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059e31d64/0xcf1365f7cb055116 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.099267:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059e31d64/0xcf1365f7cb055116 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.099289:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059e31d64/0xcf1365f7cb055116 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.099297:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059e31d64/0xcf1365f7cb055116 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.099323:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853623.099325:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853623.099327:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853623.100844:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853623.100962:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136407040 00000100:00100000:3.0:1787853623.100973:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136407040 00000100:00100000:3.0:1787853623.101052:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:3.0:1787853623.101063:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+11:2364:x1874700136407040:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1787853623.103249:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99277c24c000/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787853623.103269:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c24c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152144640:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787853623.144956:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3b7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+11:2364:x1874700136407040:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 Request processed in 43879us (44118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853623.144974:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 43 00000001:00080000:2.0:1787853623.145025:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1787853623.145055:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1787853623.145063:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1787853623.145069:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1787853623.145074:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1787853623.145080:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1787853623.148486:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853623.148623:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136407296 00000100:00100000:2.0:1787853623.148637:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136407296 00000100:00100000:2.0:1787853623.148858:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 125 00000100:00100000:2.0:1787853623.148872:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277526e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:10551:x1874700136407296:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787853623.148941:0:7618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853623.148974:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055101 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2120 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.148998:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff992743be3000) 00010000:00010000:2.0:1787853623.149004:0:7618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853623.149041:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055124 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.149057:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.149067:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787853623.149440:0:7618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a93fbedb reply state 000000007f59e098 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853623.149451:0:7618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787853623.149562:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277526e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+16:10551:x1874700136407296:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 692us (1090us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787853623.149590:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 125 00000100:00100000:1.0:1787853623.151544:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853623.151661:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136407424 00000100:00100000:3.0:1787853623.151700:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136407424 00000100:00100000:3.0:1787853623.151773:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:3.0:1787853623.151783:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277526e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2365:x1874700136407424:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787853623.152091:0:11669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787853623.152096:0:11669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787853623 -> 1787853622 00002000:00010000:3.0:1787853623.152099:0:11669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787853622 00002000:00010000:3.0:1787853623.152101:0:11669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787853623 -> 1787853622 00002000:00010000:3.0:1787853623.152104:0:11669:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787853623.152194:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277526e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2365:x1874700136407424:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 412us (660us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787853623.152204:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 44 00010000:00010000:0.0:1787853623.152259:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.152272:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055124 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.152280:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055124 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.152287:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853623.152302:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055124 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.152311:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055124 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.152332:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff992743be3000) 00010000:00010000:0.0:1787853623.152334:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853623.152339:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055124 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.152344:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055124 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853623.154275:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853623.154946:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136407680 00000100:00100000:1.0:1787853623.154960:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136407680 00000100:00100000:1.0:1787853623.155030:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 126 00000100:00100000:1.0:1787853623.155041:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:10551:x1874700136407680:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787853623.155458:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb05512b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.155481:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0550e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2112 expref: 15 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.155492:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb05512b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.155538:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0550e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2112 expref: 15 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.155556:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0550e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2112 expref: 15 pid: 7618 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853623.155574:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277526f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5824:1874700152145152:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787853623.155979:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff992766057cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853623.158848:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853623.158859:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277526f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5824:1874700152145152:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787853623.158897:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb05512b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853623.158992:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136407808 00000100:00100000:3.0:1787853623.158999:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136407808 00010000:00010000:3.0:1787853623.159050:0:8433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0550e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2112 expref: 16 pid: 7618 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853623.159085:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:3.0:1787853623.159108:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+16:2365:x1874700136407808:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853623.159125:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853623.159132:0:8433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0550e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2112 expref: 16 pid: 7618 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.159145:0:8433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0550e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2112 expref: 16 pid: 7618 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.159187:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0550e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2112 expref: 16 pid: 7618 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.159205:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff992743be3000) 00010000:00010000:3.0:1787853623.159211:0:8433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb05512b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.159222:0:8433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb05512b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.159230:0:8433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb05512b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.159257:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853623.159492:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb05512b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.159500:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb05512b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.159542:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb05512b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.159561:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb05512b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.159567:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb05512b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.159574:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853623.159579:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb05512b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.159588:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb05512b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.159599:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff992743be3000) 00010000:00010000:1.0:1787853623.159601:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787853623.159605:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb05512b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.159610:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb05512b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853623.159855:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:2365:x1874700136407808:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 745us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853623.159864:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:1.0:1787853623.160177:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:10551:x1874700136407680:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 Request processed in 5137us (5914us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787853623.160187:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 126 00000100:00100000:2.0:1787853623.164980:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853623.165087:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136407936 00000100:00100000:0.0:1787853623.165099:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136407936 00000100:00100000:0.0:1787853623.165210:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:0.0:1787853623.165222:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2362:x1874700136407936:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787853623.165296:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e882b0f/0xcf1365f7cb055132 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.165327:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001eb466e0/0xcf1365f7cb05510f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd212e expref: 7 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.165337:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853623.165342:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787853623.165348:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e882b0f/0xcf1365f7cb055132 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.165428:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001eb466e0/0xcf1365f7cb05510f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd212e expref: 7 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.165446:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001eb466e0/0xcf1365f7cb05510f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd212e expref: 7 pid: 11669 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853623.165467:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6673:1874700152145280:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787853623.165584:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277d314600 going to sleep for 11 seconds 00000100:00100000:2.0:1787853623.169019:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853623.169021:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6673:1874700152145280:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787853623.169056:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001e882b0f/0xcf1365f7cb055132 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853623.169228:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136408064 00000100:00100000:3.0:1787853623.169236:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136408064 00010000:00010000:3.0:1787853623.169288:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001eb466e0/0xcf1365f7cb05510f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd212e expref: 8 pid: 11669 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853623.169392:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 58 00000100:00100000:3.0:1787853623.169410:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2364:x1874700136408064:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853623.169430:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853623.169459:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001eb466e0/0xcf1365f7cb05510f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd212e expref: 8 pid: 11669 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.169475:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001eb466e0/0xcf1365f7cb05510f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd212e expref: 8 pid: 11669 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.169504:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001eb466e0/0xcf1365f7cb05510f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd212e expref: 8 pid: 11669 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.169524:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853623.169529:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853623.169536:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e882b0f/0xcf1365f7cb055132 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.169547:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e882b0f/0xcf1365f7cb055132 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.169580:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853623.169703:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2364:x1874700136408064:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 302us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853623.169711:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 58 00010000:00010000:0.0:1787853623.169839:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001e882b0f/0xcf1365f7cb055132 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.169849:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e882b0f/0xcf1365f7cb055132 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.169878:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001e882b0f/0xcf1365f7cb055132 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.169887:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e882b0f/0xcf1365f7cb055132 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.169906:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e882b0f/0xcf1365f7cb055132 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.169914:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8400 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853623.169919:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e882b0f/0xcf1365f7cb055132 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.169928:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e882b0f/0xcf1365f7cb055132 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.169940:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e882b0f/0xcf1365f7cb055132 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.169947:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e882b0f/0xcf1365f7cb055132 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853623.169997:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2362:x1874700136407936:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 Request processed in 4778us (5032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853623.170005:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:1.0:1787853623.172559:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853623.172705:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136408320 00000100:00100000:0.0:1787853623.172718:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136408320 00000100:00100000:0.0:1787853623.172913:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 127 00000100:00100000:0.0:1787853623.172926:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277526f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:10551:x1874700136408320:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787853623.173025:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9c00/0xcf1365f7cb055139 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.173059:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9c00/0xcf1365f7cb055139 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.173071:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9c00/0xcf1365f7cb055139 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.173355:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb055140 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.173367:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb0550f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2119 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.173376:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb055140 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.173559:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb0550f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2119 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.173577:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb0550f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2119 expref: 15 pid: 5824 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853623.173594:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5825:1874700152145408:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787853623.174360:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277d314600 going to sleep for 11 seconds 00010000:00010000:0.0:1787853623.174726:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853623.177067:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853623.177327:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5825:1874700152145408:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787853623.177361:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb055140 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853623.177485:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136408448 00000100:00100000:2.0:1787853623.177495:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136408448 00010000:00010000:2.0:1787853623.177541:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb0550f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2119 expref: 16 pid: 5824 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853623.177643:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 59 00000100:00100000:2.0:1787853623.177655:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277526f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+16:2365:x1874700136408448:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853623.177703:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853623.177712:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb0550f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2119 expref: 16 pid: 5824 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.177726:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb0550f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2119 expref: 16 pid: 5824 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.177763:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb0550f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2119 expref: 16 pid: 5824 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.177781:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff992743be3000) 00010000:00010000:2.0:1787853623.177787:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb055140 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.177797:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb055140 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.177825:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb055140 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.177846:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853623.177913:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277526f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:2365:x1874700136408448:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 260us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853623.177922:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 59 00010000:00010000:0.0:1787853623.177981:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb055140 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.177995:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb055140 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787853623.178252:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1787853623.178622:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1787853623.178721:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1787853623.178835:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5825:1874700152145536:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787853623.178917:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853623.178949:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927661690c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853623.179073:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152145536 00000100:00100000:1.0:1787853623.179090:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152145536 00000100:00100000:1.0:1787853623.179144:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787853623.179167:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5825:x1874700152145536:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787853623.179256:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5825:x1874700152145536:12345-0@lo:1000:mdt00_001.0 Request processed in 103us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853623.179263:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787853623.179665:0:5825:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787853623.179703:0:5825:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1787853623.179727:0:5825:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99277c24da40, transno 4294967309 00000004:00080000:1.0:1787853623.179739:0:5825:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99277c24c000, transno 4294967310 00000100:00100000:1.0:1787853623.179747:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3b4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5825:1874700152145536:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787853623.180387:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1787853623.180465:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277526d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5825:1874700152145664:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787853623.180513:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853623.180542:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff992766057300 going to sleep for 11 seconds 00000100:00100000:1.0:1787853623.180568:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152145664 00000100:00100000:1.0:1787853623.180574:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152145664 00000100:00100000:1.0:1787853623.180606:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787853623.180613:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277526ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5825:x1874700152145664:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787853623.181204:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277526ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5825:x1874700152145664:12345-0@lo:1000:mdt00_001.0 Request processed in 588us (687us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787853623.181214:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787853623.183026:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277526d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5825:1874700152145664:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787853623.183247:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb055140 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.183261:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb055140 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.183410:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb055140 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.183417:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853623.183422:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb055140 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.183431:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb055140 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.183451:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff992743be3000) 00010000:00010000:1.0:1787853623.183454:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787853623.183460:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb055140 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.183467:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb055140 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.183507:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055083 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.183514:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055083 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.183520:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055083 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.183527:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853623.183529:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055083 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.183546:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055083 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.183556:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:1.0:1787853623.183558:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787853623.183567:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb05508a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20fd expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.183580:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb05508a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20fd expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.183590:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb05508a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20fd expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.183635:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb05508a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20fd expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853623.183652:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277526c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5825:1874700152145792:192.168.206.10@tcp:105: 00000100:00100000:1.0:1787853623.186266:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277d314600 going to sleep for 11 seconds 00000100:00100000:2.0:1787853623.189118:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277526c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5825:1874700152145792:192.168.206.10@tcp:105: 00010000:00010000:2.0:1787853623.189171:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055083 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.189184:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055083 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.189225:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055147 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.189240:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055147 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.189254:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055147 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.189265:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055147 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.189272:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055147 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.189408:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055147 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.189431:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853623.189436:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055147 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.189444:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055147 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.189459:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:2.0:1787853623.189462:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853623.189466:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055147 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.189472:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055147 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.189483:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9c00/0xcf1365f7cb055139 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.189489:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9c00/0xcf1365f7cb055139 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.189495:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9c00/0xcf1365f7cb055139 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.189500:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a9c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853623.189503:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9c00/0xcf1365f7cb055139 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.189510:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9c00/0xcf1365f7cb055139 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.189530:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:2.0:1787853623.189532:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787853623.189536:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9c00/0xcf1365f7cb055139 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.189542:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9c00/0xcf1365f7cb055139 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853623.190458:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277526f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+18:10551:x1874700136408320:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 17527us (17903us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1787853623.190473:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 127 00000020:00080000:2.0:1787853623.190480:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787853623.191135:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787853623.191142:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787853623.191670:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787853623.191715:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787853623.202096:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853623.202200:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853623.202539:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136408576 00000100:00100000:2.0:1787853623.202552:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136408576 00000100:00100000:0.0:1787853623.202635:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136408832 00000100:00100000:0.0:1787853623.202641:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136408832 00000100:00100000:0.0:1787853623.202710:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 31 00000100:00100000:0.0:1787853623.202721:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274f706050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:10551:x1874700136408832:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787853623.203823:0:5827:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787853623.204002:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1787853623.204065:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05514e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.204085:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05514e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.204099:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05514e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.204107:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05514e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.204113:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05514e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.204126:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05514e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853623.204143:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853623.207097:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853623.207114:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05514e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.207128:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8400 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:1.0:1787853623.207133:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05514e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.207145:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05514e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.207197:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff992761dc9900) 00010000:00010000:1.0:1787853623.207201:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787853623.207207:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05514e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.207214:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05514e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853623.207239:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853623.207241:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853623.207242:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853623.207432:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274f706050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+21:10551:x1874700136408832:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 4705us (5224us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787853623.207443:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 31 00000020:00080000:1.0:1787853623.207450:0:5827:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787853623.207476:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:1.0:1787853623.207487:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+20:10550:x1874700136408576:12345-192.168.206.10@tcp:49:lfs.0 00000100:00100000:1.0:1787853623.207579:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+20:10550:x1874700136408576:12345-192.168.206.10@tcp:49:lfs.0 Request processed in 96us (5496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853623.207586:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:1.0:1787853623.214461:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853623.214551:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136409088 00000100:00100000:3.0:1787853623.214562:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136409088 00000100:00100000:3.0:1787853623.214663:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 128 00000100:00100000:3.0:1787853623.214694:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277526cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+20:10550:x1874700136409088:12345-192.168.206.10@tcp:58:lfs.0 00000040:00080000:3.0:1787853623.215225:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787853623.215458:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277526cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+20:10550:x1874700136409088:12345-192.168.206.10@tcp:58:lfs.0 Request processed in 783us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853623.215468:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 128 00000100:00100000:2.0:1787853623.253006:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853623.253130:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136409216 00000100:00100000:3.0:1787853623.253142:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136409216 00000100:00100000:3.0:1787853623.253225:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 129 00000100:00100000:3.0:1787853623.253237:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+20:10553:x1874700136409216:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787853623.253266:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853623.253290:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb055155 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2135 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.253369:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb05515c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.253386:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb05515c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.253398:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb05515c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.253433:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055163 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.253441:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.253448:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.253840:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb05516a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.253854:0:7618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb055075 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20f6 expref: 21 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.253863:0:7618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb05516a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.253903:0:7618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb055075 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20f6 expref: 21 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.253919:0:7618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb055075 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20f6 expref: 21 pid: 7618 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853623.253935:0:7618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7618:1874700152145920:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787853623.254059:0:7618:0:(client.c:2715:ptlrpc_set_wait()) set ffff992742d6d240 going to sleep for 11 seconds 00000100:00100000:0.0:1787853623.261626:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853623.261846:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136409472 00000100:00100000:1.0:1787853623.261858:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136409472 00000100:00100000:1.0:1787853623.262259:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:3.0:1787853623.262275:0:7618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7618:1874700152145920:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787853623.262275:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:5600:x1874700136409472:12345-192.168.206.10@tcp:35:ldlm_bl.0 00010000:00010000:3.0:1787853623.262371:0:7618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb05516a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853623.262597:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+23:5600:x1874700136409472:12345-192.168.206.10@tcp:35:ldlm_bl.0 Request processed in 328us (1440us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1787853623.262612:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:2.0:1787853623.268133:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853623.268536:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136409600 00000100:00100000:3.0:1787853623.268548:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136409600 00010000:00010000:3.0:1787853623.268603:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb055075 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20f6 expref: 23 pid: 7618 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853623.268651:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:3.0:1787853623.268662:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274415d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+23:2365:x1874700136409600:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853623.268705:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853623.268714:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb055075 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20f6 expref: 23 pid: 7618 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.268733:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb055075 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20f6 expref: 23 pid: 7618 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.268818:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb055075 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20f6 expref: 23 pid: 7618 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.268850:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853623.268857:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb05516a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.268868:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb05516a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.268878:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb05516a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853623.268959:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853623.269050:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274415d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:2365:x1874700136409600:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 389us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853623.269059:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 60 00010000:00010000:2.0:1787853623.270099:0:7618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb05516a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.270113:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb05516a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853623.270239:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787853623.270244:0:7618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853623.270269:0:7618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb05516a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.270285:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb05516a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.270297:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb05515c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.270318:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb05515c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.270326:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb05515c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.270333:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853623.270338:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb05515c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.270347:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb05515c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.270361:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:2.0:1787853623.270364:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853623.270369:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb05515c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.270375:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb05515c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.270390:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.270456:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055163 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.270463:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.270468:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853623.270477:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.270484:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055163 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.270492:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff992742cdd400) 00010000:00010000:2.0:1787853623.270495:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853623.270498:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055163 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.270504:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055163 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.270551:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb055155 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2135 expref: 22 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.270566:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb05516a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2135 expref: 21 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853623.270573:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:2.0:1787853623.270576:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853623.270578:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064cc00, rc 0) 00000100:00100000:2.0:1787853623.270858:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+21:10553:x1874700136409216:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 17621us (17864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853623.270868:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 129 00000040:00080000:2.0:1787853623.932013:0:12086:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787853623.932025:0:12086:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787853623.932075:0:12086:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787853623.932081:0:12086:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787853624.134790:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787853624.134821:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277526d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152146048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853624.134931:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853624.136360:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152146048 00000100:00100000:2.0:1787853624.136378:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152146048 00000100:00100000:2.0:1787853624.136480:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787853624.136492:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277526fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1874700152146048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853624.136543:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853624.136639:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277526fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1874700152146048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853624.136646:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787853624.136760:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277526d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152146048:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787853624.140388:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853624.143206:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152146304:0@lo:400:kworker.0 00000100:00100000:0.0:1787853624.143298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853624.143375:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787853624.143382:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152146432:0@lo:400:kworker.0 00000100:00100000:0.0:1787853624.143407:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853624.143444:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152146304 00000100:00100000:0.0:1787853624.143453:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152146304 00000100:00100000:0.0:1787853624.143509:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152146432 00000100:00100000:0.0:1787853624.143512:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152146432 00000100:00100000:0.0:1787853624.143543:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787853624.143561:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152146304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853624.143614:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152146304:12345-0@lo:400:kworker.0 Request processed in 55us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853624.143622:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787853624.143641:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787853624.143647:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152146432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853624.143668:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152146432:12345-0@lo:400:kworker.0 Request processed in 21us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853624.143705:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787853624.143729:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152146560:0@lo:400:kworker.0 00000100:00100000:0.0:1787853624.143756:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853624.143793:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787853624.143798:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152146176:0@lo:400:kworker.0 00000100:00100000:0.0:1787853624.143824:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853624.143842:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1874700152146688:0@lo:400:kworker.0 00000100:00100000:0.0:1787853624.144530:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853624.144628:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152146560 00000100:00100000:0.0:1787853624.144634:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152146560 00000100:00100000:0.0:1787853624.144700:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787853624.144708:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3297:x1874700152146560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853624.144750:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3b4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3297:x1874700152146560:12345-0@lo:400:kworker.0 Request processed in 44us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853624.144757:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787853624.144776:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152146176 00000100:00100000:0.0:1787853624.144779:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152146176 00000100:00100000:0.0:1787853624.144801:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787853624.144807:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152146176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853624.144837:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152146176:12345-0@lo:400:kworker.0 Request processed in 30us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853624.144844:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:0.0:1787853624.144879:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787853624.144884:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853624.145050:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152146688 00000100:00100000:3.0:1787853624.145055:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152146688 00000100:00100000:3.0:1787853624.145098:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787853624.145105:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874700152146688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853624.145145:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874700152146688:12345-0@lo:400:kworker.0 Request processed in 41us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853624.145163:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787853624.148989:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152146432:0@lo:400:kworker.0 00000100:00100000:0.0:1787853624.149050:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152146304:0@lo:400:kworker.0 00000100:00080000:0.0:1787853624.149111:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853624.149142:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152146176:0@lo:400:kworker.0 00000100:00100000:0.0:1787853624.149169:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1874700152146688:0@lo:400:kworker.0 00000100:00100000:0.0:1787853624.149212:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152146560:0@lo:400:kworker.0 00000040:00080000:3.0:1787853624.197899:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787853624.197911:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787853624.197952:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787853624.197958:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787853624.198105:0:11666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874700152146816:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787853624.198223:0:11666:0:(client.c:2715:ptlrpc_set_wait()) set ffff992742d6d9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787853624.198386:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853624.216047:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853624.216182:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136409728 00000100:00100000:1.0:1787853624.216193:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136409728 00000100:00100000:1.0:1787853624.216255:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 130 00000100:00100000:1.0:1787853624.216266:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:10565:x1874700136409728:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787853624.216311:0:5826:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787853624.216440:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:10565:x1874700136409728:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 176us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853624.216449:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 130 00000100:00100000:3.0:1787853624.218969:0:11666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874700152146816:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787853624.234536:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853624.234876:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136409984 00000100:00100000:3.0:1787853624.234889:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136409984 00000100:00100000:3.0:1787853624.235005:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 131 00000100:00100000:3.0:1787853624.235017:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+21:10565:x1874700136409984:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787853624.235043:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853624.235069:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055171 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd213c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853624.235210:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb055178 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853624.235249:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb055178 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853624.235263:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb055178 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853624.235275:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787853624.235434:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055171 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd213c expref: 24 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853624.235457:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb055178 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd213c expref: 23 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853624.235466:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853624.235469:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853624.235473:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064dc00, rc 0) 00000100:00100000:3.0:1787853624.235614:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+23:10565:x1874700136409984:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 599us (1093us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1787853624.235624:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 131 00000100:00100000:2.0:1787853624.242838:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853624.242969:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136410112 00000100:00100000:3.0:1787853624.242980:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136410112 00000100:00100000:3.0:1787853624.243133:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:3.0:1787853624.243147:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+23:2364:x1874700136410112:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853624.243269:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853624.243301:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb055178 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd213c expref: 23 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853624.243348:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853624.243354:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853624.244371:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:2364:x1874700136410112:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 1219us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853624.244384:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:1.0:1787853624.249337:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853624.249513:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136410368 00000100:00100000:3.0:1787853624.249526:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136410368 00000100:00100000:3.0:1787853624.249599:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 132 00000100:00100000:3.0:1787853624.249610:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277526d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:10565:x1874700136410368:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787853624.249904:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055186 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853624.249999:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055186 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853624.250107:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055186 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853624.250537:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055186 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853624.250547:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055186 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853624.250559:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055186 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853624.250566:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064c200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853624.250589:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055186 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853624.250598:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055186 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853624.250614:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853624.250617:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787853624.250622:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055186 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853624.250629:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055186 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853624.251145:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277526d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+23:10565:x1874700136410368:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 1530us (2238us total) trans 4294967411 rc 0/0 00000040:00080000:2.0:1787853624.251389:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787853624.251396:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1787853624.251503:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 132 00000040:00080000:2.0:1787853624.252769:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787853624.252785:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787853624.259124:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853624.259394:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136410624 00000100:00100000:0.0:1787853624.259406:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136410624 00000100:00100000:0.0:1787853624.259487:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:0.0:1787853624.259498:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+23:10565:x1874700136410624:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787853624.259850:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+24:10565:x1874700136410624:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 353us (743us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787853624.259860:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 34 00010000:00010000:0.0:1787853625.222078:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787853625.756668:0:12137:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787853625.756727:0:12137:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787853625.756972:0:12137:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787853625.756981:0:12137:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787853625.895888:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853625.897560:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136410880 00000100:00100000:0.0:1787853625.897572:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136410880 00000100:00100000:0.0:1787853625.897645:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 133 00000100:00100000:0.0:1787853625.897654:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277526cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+24:10585:x1874700136410880:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787853625.897696:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853625.897717:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb05518d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2143 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853625.897944:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9e00/0xcf1365f7cb055194 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853625.897958:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9e00/0xcf1365f7cb055194 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853625.897983:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9e00/0xcf1365f7cb055194 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853625.897996:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787853625.898110:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb05518d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2143 expref: 27 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853625.898126:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9e00/0xcf1365f7cb055194 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2143 expref: 26 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853625.898135:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:0.0:1787853625.898138:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787853625.898151:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a9e00, rc 0) 00000100:00080000:2.0:1787853625.898315:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853625.898366:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277526cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+26:10585:x1874700136410880:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 713us (2484us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1787853625.898374:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 133 00000100:00100000:0.0:1787853625.901269:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853625.901378:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136411008 00000100:00100000:3.0:1787853625.901390:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136411008 00000100:00100000:3.0:1787853625.901459:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 134 00000100:00100000:3.0:1787853625.901472:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+26:10585:x1874700136411008:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:3.0:1787853625.901562:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb0551a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853625.901581:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb0551a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853625.901595:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb0551a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853625.901627:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb0551a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853625.901650:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb0551a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853625.901658:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb0551a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853625.901665:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064dc00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853625.901728:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb0551a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853625.901739:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb0551a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853625.901754:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853625.901757:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787853625.901763:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb0551a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853625.901770:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064dc00/0xcf1365f7cb0551a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853625.901868:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+26:10585:x1874700136411008:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 399us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853625.901878:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 134 00000100:00100000:2.0:1787853625.973717:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853625.973941:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136411136 00000100:00100000:3.0:1787853625.973951:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136411136 00000100:00080000:2.0:1787853625.974069:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853625.974371:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:3.0:1787853625.974383:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2365:x1874700136411136:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:3.0:1787853625.974400:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853625.974433:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000043a805f/0xcf1365f7cb0551a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd214a expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787853625.974459:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a907b36, atime: 0x6a907b36, ctime: 0x6a907b36, blocks: 0xb 00010000:00010000:3.0:1787853625.974478:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=320s v=(0 0) 00010000:00010000:3.0:1787853625.974483:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853625.974492:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000043a805f/0xcf1365f7cb0551a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd214a expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853625.974511:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000043a805f/0xcf1365f7cb0551a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd214a expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853625.974525:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064dc00, rc 0) 00000100:00100000:3.0:1787853625.974587:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2365:x1874700136411136:12345-192.168.206.10@tcp:101:cat.0 Request processed in 206us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853625.974595:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:0.0:1787853625.979633:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853625.979740:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136411264 00000100:00100000:2.0:1787853625.979753:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136411264 00002000:00100000:2.0:1787853625.979805:0:6677:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff99277c3b61c0 x1874700136411264/t0(0) o3->0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp:46/0 lens 488/0 e 0 to 0 dl 1787853636 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787853625.979817:0:6677:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99277c3b61c0 with x1874700136411264 ext(0->4095) 00002000:00010000:2.0:1787853625.979823:0:6677:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99277c3b61c0 00000100:00100000:2.0:1787853625.979864:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:2.0:1787853625.979872:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2365:x1874700136411264:12345-192.168.206.10@tcp:3:cat.0 00000100:00100000:2.0:1787853625.980194:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2365:x1874700136411264:12345-192.168.206.10@tcp:3:cat.0 Request processed in 320us (574us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787853625.980203:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 3 00002000:00100000:2.0:1787853625.980209:0:6677:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff99277c3b61c0 x1874700136411264/t0(0) o3->0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp:46/0 lens 488/4536 e 0 to 0 dl 1787853636 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787853625.980216:0:6677:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99277c3b61c0 with x1874700136411264 ext(0->4095) 00002000:00010000:2.0:1787853625.980219:0:6677:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99277c3b61c0 00010000:00010000:0.0:1787853626.249801:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787853626.758470:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1787853626.758489:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1787853626.758494:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1787853626.811763:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853626.811843:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853626.811877:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853626.811905:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853626.811927:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853626.811992:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136411392 00000100:00100000:1.0:1787853626.812001:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136411392 00000100:00100000:0.0:1787853626.812002:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136411776 00000100:00100000:0.0:1787853626.812009:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136411776 00000100:00100000:1.0:1787853626.812051:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 287 00000100:00100000:0.0:1787853626.812058:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136411648 00000100:00100000:1.0:1787853626.812063:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2364:x1874700136411392:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853626.812064:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136411648 00000100:00100000:0.0:1787853626.812091:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00100000:0.0:1787853626.812100:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277526c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2364:x1874700136411776:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853626.812133:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2364:x1874700136411392:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 72us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853626.812148:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277526c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2364:x1874700136411776:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 48us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853626.812165:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 287 00000100:00100000:0.0:1787853626.812174:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00100000:0.0:1787853626.812192:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00100000:0.0:1787853626.812200:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2364:x1874700136411648:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787853626.812261:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136411520 00000100:00100000:3.0:1787853626.812266:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136411520 00000100:00100000:3.0:1787853626.812299:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136411904 00000100:00100000:3.0:1787853626.812303:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136411904 00000100:00100000:0.0:1787853626.812309:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2364:x1874700136411648:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 109us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853626.812318:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00100000:3.0:1787853626.812334:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 133 00000100:00100000:3.0:1787853626.812343:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277526f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+26:2364:x1874700136411520:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853626.812351:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 134 00000100:00100000:0.0:1787853626.812362:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2364:x1874700136411904:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787853626.812381:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277526f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+26:2364:x1874700136411520:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 38us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853626.812389:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 133 00000100:00100000:0.0:1787853626.812611:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2364:x1874700136411904:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 250us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853626.812618:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 134 00000100:00080000:0.0:1787853626.812637:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787853626.812642:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787853627.206983:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787853627.207013:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761ea43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152146944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853627.207076:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853627.207145:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152146944 00000100:00100000:2.0:1787853627.207151:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152146944 00000100:00100000:2.0:1787853627.207201:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787853627.207209:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874700152146944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853627.207239:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853627.207281:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874700152146944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853627.207288:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1787853627.207306:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853627.207339:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761ea43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152146944:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787853627.277602:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853628.304857:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787853628.304943:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1787853628.304955:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1787853628.308971:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1787853628.309004:0:5846:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff992766057840 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787853628.309016:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99276e808b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff992766057cc0 00000020:00080000:2.0:1787853628.309020:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99276e808a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99276de02c00 00000020:00080000:0.0:1787853628.309052:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:0.0:1787853628.309241:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1787853628.309331:0:5846:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000100:00100000:2.0:1787853629.254033:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c203c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152147072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853629.254099:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853629.254177:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152147072 00000100:00100000:2.0:1787853629.254183:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152147072 00000100:00100000:2.0:1787853629.254232:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787853629.254240:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c2030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152147072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787853629.254280:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853629.254321:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c2030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152147072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853629.254327:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1787853629.254347:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787853629.254372:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1787853629.254377:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1787853629.254398:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99277c3b4f00, transno 4294967304 00000100:00100000:2.0:1787853629.254414:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c203c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152147072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853629.254795:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c203c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152147200:0@lo:400:kworker.0 00000100:00100000:2.0:1787853629.254832:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853629.254869:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1874700152147712:0@lo:400:kworker.0 00000100:00100000:1.0:1787853629.254881:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152147200 00000100:00100000:1.0:1787853629.254887:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152147200 00000100:00100000:2.0:1787853629.254899:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853629.254924:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853629.254930:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c201680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152147328:0@lo:400:kworker.0 00000100:00100000:2.0:1787853629.254958:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853629.254966:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787853629.254977:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152147200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853629.255012:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152147712 00000100:00100000:2.0:1787853629.255017:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152147712 00000100:00100000:1.0:1787853629.255027:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152147200:12345-0@lo:400:kworker.0 Request processed in 52us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853629.255035:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787853629.255058:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152147328 00000100:00100000:2.0:1787853629.255063:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152147328 00000100:00100000:1.0:1787853629.255085:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c203c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152147200:0@lo:400:kworker.0 00000100:00100000:2.0:1787853629.255091:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787853629.255099:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874700152147712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853629.255164:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874700152147712:12345-0@lo:400:kworker.0 Request processed in 67us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853629.255171:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787853629.255186:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787853629.255194:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152147328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853629.255226:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152147328:12345-0@lo:400:kworker.0 Request processed in 33us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853629.255231:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787853629.255257:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c203840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152147456:0@lo:400:kworker.0 00000100:00100000:2.0:1787853629.255281:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853629.255300:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787853629.255305:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dc9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152147584:0@lo:400:kworker.0 00000100:00100000:2.0:1787853629.255328:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853629.255351:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152147456 00000100:00100000:2.0:1787853629.255354:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152147456 00000100:00100000:2.0:1787853629.255379:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787853629.255386:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152147456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853629.255418:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152147456:12345-0@lo:400:kworker.0 Request processed in 33us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853629.255424:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787853629.255441:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152147584 00000100:00100000:2.0:1787853629.255450:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152147584 00000100:00100000:2.0:1787853629.255480:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787853629.255486:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152147584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853629.255517:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152147584:12345-0@lo:400:kworker.0 Request processed in 31us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853629.255523:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1787853629.255541:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787853629.255544:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853629.255561:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1787853629.255565:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1787853629.255579:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dc9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152147584:0@lo:400:kworker.0 00000100:00100000:2.0:1787853629.255590:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c203840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152147456:0@lo:400:kworker.0 00000100:00100000:1.0:1787853629.256041:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c201680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152147328:0@lo:400:kworker.0 00000100:00100000:1.0:1787853629.256055:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1874700152147712:0@lo:400:kworker.0 00010000:00010000:2.0:1787853629.318174:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853630.206799:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853630.206962:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136412032 00000100:00100000:2.0:1787853630.206972:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136412032 00000100:00100000:2.0:1787853630.207048:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 135 00000100:00100000:2.0:1787853630.207058:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+13:10230:x1874700136412032:12345-192.168.206.10@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1787853630.207152:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853630.207174:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+13:10230:x1874700136412032:12345-192.168.206.10@tcp:60:lhsmtool_posix.0 Request processed in 115us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853630.207184:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 135 00000100:00100000:0.0:1787853630.212838:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853630.212916:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136412288 00000100:00100000:1.0:1787853630.212925:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136412288 00000100:00100000:1.0:1787853630.212986:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:1.0:1787853630.212996:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+13:10230:x1874700136412288:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787853630.213446:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:10230:x1874700136412288:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 450us (615us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787853630.213454:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 35 00010000:00010000:0.0:1787853630.343324:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787853630.407649:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787853630.407670:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787853630.407975:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1787853630.407981:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787853630.449569:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853630.450026:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136412416 00000100:00100000:2.0:1787853630.450040:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136412416 00000100:00100000:2.0:1787853630.450148:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 136 00000100:00100000:2.0:1787853630.450159:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:11037:x1874700136412416:12345-192.168.206.10@tcp:101:lsof.0 00010000:00010000:2.0:1787853630.450179:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1787853630.450187:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787853630.450201:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb0551b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2151 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853630.450279:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0551b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853630.450294:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0551b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853630.450305:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0551b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853630.450475:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787853630.450479:0:5826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853630.450587:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0551b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853630.450611:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb0551b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2151 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853630.450629:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0551b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2151 expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853630.450637:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992743be3e00) 00010000:00010000:2.0:1787853630.450640:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853630.450643:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71a00, rc 0) 00000100:00100000:2.0:1787853630.450757:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:11037:x1874700136412416:12345-192.168.206.10@tcp:101:lsof.0 Request processed in 599us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853630.450764:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 136 00010000:00010000:3.0:1787853631.366372:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853631.933318:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853631.933364:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853631.933473:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853631.933509:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853631.933540:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853631.933595:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136413056 00000100:00100000:1.0:1787853631.933605:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136413056 00000100:00100000:1.0:1787853631.933653:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136412672 00000100:00100000:1.0:1787853631.933656:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136412672 00000100:00100000:1.0:1787853631.933697:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 138 00000100:00100000:1.0:1787853631.933708:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:2364:x1874700136413056:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853631.933782:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:2364:x1874700136413056:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 76us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853631.933790:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 138 00000100:00100000:1.0:1787853631.933808:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 139 00000100:00100000:1.0:1787853631.933815:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:2364:x1874700136412672:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853631.933843:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:2364:x1874700136412672:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 29us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853631.933849:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 139 00000100:00100000:0.0:1787853631.934873:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136412544 00000100:00100000:0.0:1787853631.934881:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136412544 00000100:00100000:0.0:1787853631.934931:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 289 00000100:00100000:0.0:1787853631.934940:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2364:x1874700136412544:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853631.934999:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2364:x1874700136412544:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 60us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853631.935006:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 289 00000100:00100000:3.0:1787853631.943348:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136412800 00000100:00100000:3.0:1787853631.943360:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136412800 00000100:00100000:0.0:1787853631.944153:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136412928 00000100:00100000:0.0:1787853631.944159:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136412928 00000100:00100000:0.0:1787853631.944242:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:0.0:1787853631.944256:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2364:x1874700136412928:12345-192.168.206.10@tcp:400:kworker.0 00000100:00080000:2.0:1787853631.944363:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787853631.944806:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:1.0:1787853631.944815:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2364:x1874700136412800:12345-192.168.206.10@tcp:400:kworker.0 00000100:00080000:2.0:1787853631.946225:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853631.948395:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2364:x1874700136412928:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 4136us (14845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853631.948408:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:1.0:1787853631.948506:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2364:x1874700136412800:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 3691us (15141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853631.948515:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:1.0:1787853632.326334:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787853632.326357:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277526d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152147840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853632.326421:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853632.326562:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152147840 00000100:00100000:2.0:1787853632.326570:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152147840 00000100:00100000:2.0:1787853632.326633:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787853632.326642:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152147840:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787853632.326648:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787853632.326690:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853632.326740:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152147840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853632.326747:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787853632.328396:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277526d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152147840:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787853632.390164:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787853633.410653:0:5846:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:2.0:1787853633.410696:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1787853633.410714:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1787853633.410731:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1787853633.413964:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787853633.858062:0:12340:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 14:00:32 (1787853632) 00000100:00100000:0.0:1787853634.374927:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dac0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152148096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853634.374994:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853634.375061:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853634.375069:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277526d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152147968:0@lo:400:kworker.0 00000100:00100000:1.0:1787853634.375109:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152148096 00000100:00100000:0.0:1787853634.375120:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853634.375121:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152148096 00000100:00100000:0.0:1787853634.375191:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152147968 00000100:00100000:0.0:1787853634.375199:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152147968 00000100:00100000:1.0:1787853634.375215:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787853634.375230:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3b5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152148096:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853634.375247:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787853634.375260:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3300:x1874700152147968:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1787853634.375277:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853634.375312:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3300:x1874700152147968:12345-0@lo:400:kworker.0 Request processed in 55us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853634.375321:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787853634.375369:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3b5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152148096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (371us total) trans 0 rc 0/0 00000100:00080000:0.0:1787853634.375377:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787853634.375397:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787853634.375413:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277526d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152147968:0@lo:400:kworker.0 00000100:00100000:0.0:1787853634.375444:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dac0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152148096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853634.375896:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927500d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152148608:0@lo:400:kworker.0 00000100:00100000:2.0:1787853634.376043:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853634.376056:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642106580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152148224:0@lo:400:kworker.0 00000100:00100000:2.0:1787853634.376074:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787853634.376085:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927500d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152148480:0@lo:400:kworker.0 00000100:00100000:2.0:1787853634.376129:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853634.376234:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152148480 00000100:00100000:3.0:1787853634.376240:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152148480 00000100:00100000:3.0:1787853634.376285:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787853634.376293:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152148480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853634.376333:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152148480:12345-0@lo:400:kworker.0 Request processed in 41us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853634.376340:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1787853634.376362:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853634.376383:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152148608 00000100:00100000:3.0:1787853634.376387:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152148608 00000100:00100000:3.0:1787853634.376417:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787853634.376424:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152148608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853634.376456:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152148608:12345-0@lo:400:kworker.0 Request processed in 33us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853634.376462:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1787853634.376477:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853634.376538:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927500d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1874700152148352:0@lo:400:kworker.0 00000100:00100000:0.0:1787853634.376568:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853634.376647:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927500d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152148480:0@lo:400:kworker.0 00000100:00100000:2.0:1787853634.376657:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927500d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152148608:0@lo:400:kworker.0 00000100:00100000:1.0:1787853634.376806:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853634.378029:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152148352 00000100:00100000:0.0:1787853634.378038:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152148352 00000100:00100000:0.0:1787853634.378114:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152148224 00000100:00100000:0.0:1787853634.378118:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152148224 00000100:00100000:0.0:1787853634.378141:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787853634.378219:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874700152148352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853634.378286:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874700152148352:12345-0@lo:400:kworker.0 Request processed in 138us (1717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853634.378294:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787853634.378310:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787853634.378316:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dac0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152148224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853634.378349:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dac0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152148224:12345-0@lo:400:kworker.0 Request processed in 33us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853634.378355:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787853634.378393:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927500d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1874700152148352:0@lo:400:kworker.0 00000100:00100000:1.0:1787853634.378507:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642106580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152148224:0@lo:400:kworker.0 00000100:00080000:2.0:1787853634.379736:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787853634.437969:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853635.105268:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853635.105550:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136413312 00000100:00100000:3.0:1787853635.105563:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136413312 00000100:00100000:3.0:1787853635.105660:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 137 00000100:00100000:3.0:1787853635.105709:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277526d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+13:11302:x1874700136413312:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787853635.105734:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853635.105760:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb0551be lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2158 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.105889:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb0551c5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.105908:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb0551c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.105925:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb0551c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.105942:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0551cc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.105948:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0551cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.105955:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0551cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.106734:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0551d3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.106748:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0551d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.106756:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0551d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853635.106768:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787853635.107411:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb0551c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.107423:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb0551c5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.107439:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb0551c5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.107446:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853635.107451:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb0551c5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.107459:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb0551c5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.107476:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff992743be3f00) 00010000:00010000:3.0:1787853635.107480:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853635.107486:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb0551c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.107493:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb0551c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.107508:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0551cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.107515:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0551cc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.107521:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0551cc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.107527:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064c200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853635.107530:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0551cc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.107547:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0551cc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.107557:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff992742cdd900) 00010000:00010000:3.0:1787853635.107559:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853635.107562:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0551cc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.107568:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0551cc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787853635.107851:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787853635.108429:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb0551be lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2158 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.108453:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0551d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2158 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.108461:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff992761dc9700) 00010000:00010000:3.0:1787853635.108463:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853635.108466:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064d000, rc 0) 00000100:00100000:3.0:1787853635.108552:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277526d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:11302:x1874700136413312:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 2881us (3299us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1787853635.108563:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 137 00000100:00100000:3.0:1787853635.112439:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853635.112988:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136413440 00000100:00100000:1.0:1787853635.113000:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136413440 00000100:00100000:1.0:1787853635.113073:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 138 00000100:00100000:1.0:1787853635.113084:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:11302:x1874700136413440:12345-192.168.206.10@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787853635.113343:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:11302:x1874700136413440:12345-192.168.206.10@tcp:59:lhsmtool_posix.0 Request processed in 260us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853635.113352:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 138 00000100:00100000:2.0:1787853635.123100:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853635.123257:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136413568 00000100:00100000:3.0:1787853635.123269:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136413568 00000100:00100000:3.0:1787853635.123393:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:3.0:1787853635.123405:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:2365:x1874700136413568:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853635.123446:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853635.123478:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0551d3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2158 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853635.123503:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff992761dc9700) 00010000:00010000:3.0:1787853635.123509:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853635.123592:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:2365:x1874700136413568:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 189us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853635.123601:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00010000:00010000:3.0:1787853635.462003:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787853635.528661:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787853635.529364:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787853635.529425:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1787853635.529432:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787853636.485838:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853637.063489:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853637.063538:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853637.063579:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853637.063624:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853637.063652:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853637.063713:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136414208 00000100:00100000:0.0:1787853637.063726:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136414208 00000100:00100000:0.0:1787853637.063799:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136413824 00000100:00100000:0.0:1787853637.063803:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136413824 00000100:00100000:0.0:1787853637.063829:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 143 00000100:00100000:0.0:1787853637.063840:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276ae0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:2364:x1874700136414208:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853637.063929:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276ae0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:2364:x1874700136414208:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 90us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853637.063937:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 143 00000100:00100000:0.0:1787853637.063956:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 144 00000100:00100000:0.0:1787853637.063963:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276ae0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:2364:x1874700136413824:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853637.063988:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276ae0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:2364:x1874700136413824:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 26us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853637.063995:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 144 00000100:00080000:0.0:1787853637.064016:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853637.064209:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136413952 00000100:00100000:2.0:1787853637.064215:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136413952 00000100:00100000:2.0:1787853637.064258:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136414080 00000100:00100000:2.0:1787853637.064261:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136414080 00000100:00100000:2.0:1787853637.064294:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:2.0:1787853637.064302:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276ae0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2364:x1874700136413952:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853637.064333:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276ae0d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2364:x1874700136413952:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 32us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853637.064340:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:2.0:1787853637.064354:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:2.0:1787853637.064360:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274368a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2364:x1874700136414080:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853637.064383:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274368a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2364:x1874700136414080:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 24us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853637.064389:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:1.0:1787853637.064477:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136413696 00000100:00100000:1.0:1787853637.064482:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136413696 00000100:00100000:1.0:1787853637.064524:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 291 00000100:00100000:1.0:1787853637.064531:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2364:x1874700136413696:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853637.064559:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2364:x1874700136413696:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 29us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853637.064565:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 291 00000100:00080000:1.0:1787853637.065809:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787853637.065820:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853637.090160:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853637.090250:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136414336 00000100:00100000:1.0:1787853637.090263:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136414336 00000100:00100000:1.0:1787853637.090338:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 139 00000100:00100000:1.0:1787853637.090350:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:11344:x1874700136414336:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787853637.090376:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853637.090413:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb0551e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd215f expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.090503:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0551e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.090521:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0551e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.090538:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0551e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.090557:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0551ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.090565:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0551ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.090572:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0551ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.090894:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0551e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.090903:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0551e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.090910:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0551e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.090917:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853637.090922:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0551e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.091004:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0551e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.091022:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992743be3e00) 00010000:00010000:1.0:1787853637.091026:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853637.091033:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0551e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.091039:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0551e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.091053:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0551ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.091058:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0551ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.091064:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0551ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.091070:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853637.091073:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0551ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.091156:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0551ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.091166:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9927433f1000) 00010000:00010000:1.0:1787853637.091169:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853637.091172:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0551ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.091188:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0551ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.091230:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb0551e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd215f expref: 15 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.091242:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992743be3e00) 00010000:00010000:1.0:1787853637.091244:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853637.091248:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb0551e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd215f expref: 15 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853637.091258:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196200, rc 0) 00000100:00100000:1.0:1787853637.091337:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:11344:x1874700136414336:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 989us (1256us total) trans 0 rc 301/301 00000100:00100000:1.0:1787853637.091346:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 139 00000100:00100000:1.0:1787853637.097913:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853637.098004:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136414592 00000100:00100000:2.0:1787853637.098026:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136414592 00000100:00100000:2.0:1787853637.098106:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 140 00000100:00100000:2.0:1787853637.098117:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c201680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:11344:x1874700136414592:12345-192.168.206.10@tcp:36:lfs.0 00010000:00010000:2.0:1787853637.098188:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853637.098222:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740031a00/0xcf1365f7cb054b5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f98 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.098242:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992743be3e00) 00010000:00010000:2.0:1787853637.098248:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853637.098582:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0551f6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.098607:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0551b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2151 expref: 5 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.098617:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0551f6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.098658:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0551b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2151 expref: 5 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.098718:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0551b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2151 expref: 5 pid: 5826 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853637.098735:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927500d3840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5826:1874700152148736:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787853637.098850:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927660f93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853637.111576:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853637.112014:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136414720 00000100:00100000:0.0:1787853637.112035:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136414720 00010000:00010000:0.0:1787853637.112106:0:8433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0551b7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2151 expref: 6 pid: 5826 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853637.112151:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:0.0:1787853637.112163:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c203840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:2364:x1874700136414720:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853637.112181:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853637.112188:0:8433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0551b7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2151 expref: 6 pid: 5826 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.112222:0:8433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0551b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2151 expref: 6 pid: 5826 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.112250:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992743be3e00) 00010000:00010000:0.0:1787853637.112256:0:8433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0551f6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.112267:0:8433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0551f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.112275:0:8433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0551f6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.112296:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853637.112358:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c203840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:2364:x1874700136414720:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 198us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853637.112365:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 61 00010000:00010000:2.0:1787853637.115567:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0551b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2151 expref: 5 pid: 5826 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853637.115605:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927500d3840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5826:1874700152148736:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787853637.115643:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0551f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.115654:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0551f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.115660:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0551f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.115713:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0551fd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.115739:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0551fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.115756:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0551fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853637.120993:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787853637.121028:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0551f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.121042:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0551f6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.121050:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0551f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.121056:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853637.121062:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0551f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.121071:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0551f6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.121100:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992743be3e00) 00010000:00010000:2.0:1787853637.121104:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853637.121109:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0551f6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.121116:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0551f6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787853637.121150:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc8a603f reply state 00000000942d854d transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0551fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853637.121160:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787853637.121293:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c201680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:11344:x1874700136414592:12345-192.168.206.10@tcp:36:lfs.0 Request processed in 23173us (23385us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787853637.121303:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 140 00010000:00010000:2.0:1787853637.132234:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0551fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.132256:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0551fd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.132265:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0551fd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.132271:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853637.132277:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0551fd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.132286:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0551fd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.132308:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff992743be3800) 00010000:00010000:2.0:1787853637.132311:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853637.132317:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0551fd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.132323:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0551fd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853637.240093:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853637.240277:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136414848 00000100:00100000:0.0:1787853637.240290:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136414848 00000100:00100000:0.0:1787853637.240367:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 141 00000100:00100000:0.0:1787853637.240379:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c203c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+14:11352:x1874700136414848:12345-192.168.206.10@tcp:101:lctl.0 00010000:00010000:0.0:1787853637.240421:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853637.240451:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055204 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2166 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.240542:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9000/0xcf1365f7cb05520b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.240581:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9000/0xcf1365f7cb05520b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.240595:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9000/0xcf1365f7cb05520b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853637.240728:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787853637.240733:0:7618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853637.240763:0:7618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9000/0xcf1365f7cb05520b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.240792:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055204 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2166 expref: 16 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.240812:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9000/0xcf1365f7cb05520b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2166 expref: 15 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.240822:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992761dc9f00) 00010000:00010000:0.0:1787853637.240825:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787853637.240830:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a9000, rc 0) 00000100:00100000:0.0:1787853637.240904:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c203c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:11352:x1874700136414848:12345-192.168.206.10@tcp:101:lctl.0 Request processed in 527us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853637.240912:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 141 00000100:00100000:0.0:1787853637.316018:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853637.316570:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136414976 00000100:00100000:3.0:1787853637.316583:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136414976 00000100:00100000:3.0:1787853637.316659:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 142 00000100:00100000:3.0:1787853637.316713:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:11358:x1874700136414976:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787853637.316739:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853637.316766:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055212 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd216d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.316857:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb055219 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.316875:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb055219 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.316910:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb055219 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.316930:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055220 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.316938:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055220 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.316945:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055220 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.317110:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb055227 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.317119:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb055227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.317126:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb055227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853637.317162:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787853637.317166:0:5825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853637.317191:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb055227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.317204:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb055219 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.317212:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb055219 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.317229:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb055219 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.317235:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853637.317240:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb055219 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.317249:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb055219 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.317263:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992761dc9f00) 00010000:00010000:3.0:1787853637.317266:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853637.317272:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb055219 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.317279:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb055219 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.317295:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055220 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.317301:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055220 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.317307:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055220 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.317313:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064c200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853637.317316:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055220 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.317844:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055220 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.317866:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff992742cdd900) 00010000:00010000:3.0:1787853637.317869:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853637.317876:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055220 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.317884:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb055220 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.318055:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055212 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd216d expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.318072:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb055227 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd216d expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.318091:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:3.0:1787853637.318093:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787853637.318096:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064d200, rc 0) 00000100:00100000:3.0:1787853637.318173:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+16:11358:x1874700136414976:12345-192.168.206.10@tcp:101:bash.0 Request processed in 1503us (2168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853637.318183:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 142 00000100:00100000:1.0:1787853637.324923:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853637.325222:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136415232 00000100:00100000:3.0:1787853637.325299:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136415232 00000100:00100000:3.0:1787853637.325424:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 143 00000100:00100000:3.0:1787853637.325437:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+16:11358:x1874700136415232:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787853637.325497:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853637.325522:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb05522e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2174 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.325752:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055235 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.325769:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055235 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.325781:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055235 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.325938:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb05523c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.325961:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb05523c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.325976:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb05523c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787853637.328780:0:5824:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787853637.328969:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055243 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.328986:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.328997:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.329047:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055235 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.329054:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055235 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.329060:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055235 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.329066:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c7800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853637.329070:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055235 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.329088:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055235 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.329101:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:3.0:1787853637.329104:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853637.329109:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055235 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.329115:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055235 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853637.329129:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003389783 reply state 0000000037ec946c transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb05523c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853637.329137:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787853637.329171:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb05522e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2174 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.329197:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055243 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2174 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.329205:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cdd900) 00010000:00010000:3.0:1787853637.329207:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853637.329210:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064d400, rc 0) 00000100:00100000:3.0:1787853637.329285:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:11358:x1874700136415232:12345-192.168.206.10@tcp:101:bash.0 Request processed in 3850us (4375us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1787853637.329294:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 143 00010000:00010000:0.0:1787853637.335422:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb05523c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.335438:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb05523c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.335462:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb05523c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.335469:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c6800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853637.335473:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb05523c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.335482:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb05523c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.335497:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff992742cdd800) 00010000:00010000:0.0:1787853637.335500:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853637.335504:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb05523c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.335510:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb05523c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853637.335884:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853637.335977:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136415360 00000100:00100000:2.0:1787853637.335994:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136415360 00000100:00100000:2.0:1787853637.336051:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:2.0:1787853637.336061:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c7a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2363:x1874700136415360:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:2.0:1787853637.336075:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853637.336105:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072ab78fc/0xcf1365f7cb055251 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd217b expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787853637.336130:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853637.336147:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=331s v=(0 0) 00010000:00010000:2.0:1787853637.336153:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853637.336162:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072ab78fc/0xcf1365f7cb055251 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd217b expref: 6 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.336178:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072ab78fc/0xcf1365f7cb055251 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd217b expref: 6 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.336189:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70c00, rc 0) 00000100:00100000:2.0:1787853637.336241:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c7a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2363:x1874700136415360:12345-192.168.206.10@tcp:101:bash.0 Request processed in 183us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853637.336248:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:0.0:1787853637.339252:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853637.339430:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136415488 00000100:00100000:2.0:1787853637.339440:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136415488 00000100:00100000:2.0:1787853637.339543:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:2.0:1787853637.339553:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:11358:x1874700136415488:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:2.0:1787853637.339584:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853637.339601:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034748a21/0xcf1365f7cb055258 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2182 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.339630:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000072ab78fc/0xcf1365f7cb055251 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd217b expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.339639:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853637.339643:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853637.339649:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034748a21/0xcf1365f7cb055258 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2182 expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.339722:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000072ab78fc/0xcf1365f7cb055251 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd217b expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.339736:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000072ab78fc/0xcf1365f7cb055251 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd217b expref: 7 pid: 6673 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853637.339749:0:6671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927500d3840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1874700152148864:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787853637.339832:0:6671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927660f93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853637.348814:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853637.349018:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136415616 00000100:00100000:3.0:1787853637.349027:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136415616 00010000:00010000:3.0:1787853637.349066:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000072ab78fc/0xcf1365f7cb055251 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd217b expref: 8 pid: 6673 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853637.349119:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00100000:3.0:1787853637.349129:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99275aa283c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2365:x1874700136415616:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853637.349144:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853637.349164:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000072ab78fc/0xcf1365f7cb055251 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd217b expref: 8 pid: 6673 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.349179:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000072ab78fc/0xcf1365f7cb055251 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd217b expref: 8 pid: 6673 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.349205:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853637.349223:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853637.349232:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000034748a21/0xcf1365f7cb055258 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2182 expref: 8 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.349241:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034748a21/0xcf1365f7cb055258 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2182 expref: 8 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.349275:0:5810:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000034748a21/0xcf1365f7cb055258 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2182 expref: 8 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853637.349289:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78e940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5810:1874700152148992:192.168.206.10@tcp:105: 00000100:00100000:3.0:1787853637.349367:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c096d80 going to sleep for 11 seconds 00010000:00010000:2.0:1787853637.351285:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072ab78fc/0xcf1365f7cb055251 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd217b expref: 8 pid: 6673 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853637.351307:0:6671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927500d3840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1874700152148864:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787853637.351334:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000034748a21/0xcf1365f7cb055258 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2182 expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.351362:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70000, rc 0) 00000100:00100000:2.0:1787853637.351431:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:11358:x1874700136415488:12345-192.168.206.10@tcp:101:bash.0 Request processed in 11879us (12186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853637.351439:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:3.0:1787853637.353786:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78e940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5810:1874700152148992:192.168.206.10@tcp:105: 00010000:00010000:3.0:1787853637.353810:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853637.353907:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99275aa283c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2365:x1874700136415616:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 4778us (5099us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853637.353928:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00100000:1.0:1787853637.366571:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853637.366825:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136415872 00000100:00100000:2.0:1787853637.366835:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136415872 00000100:00100000:2.0:1787853637.366889:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:2.0:1787853637.366899:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99275aa2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+18:11358:x1874700136415872:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:2.0:1787853637.367227:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99275aa2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:11358:x1874700136415872:12345-192.168.206.10@tcp:35:bash.0 Request processed in 329us (664us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1787853637.367236:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:0.0:1787853637.447642:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787853637.447664:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927500d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152149120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853637.447779:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853637.448211:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152149120 00000100:00100000:1.0:1787853637.448219:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152149120 00000100:00100000:1.0:1787853637.448282:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787853637.448290:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152149120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787853637.448321:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853637.448380:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152149120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853637.448388:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1787853637.448509:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853637.448548:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927500d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152149120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853637.456134:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853637.456282:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136416128 00000100:00100000:2.0:1787853637.456292:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136416128 00000100:00100000:2.0:1787853637.456354:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 144 00000100:00100000:2.0:1787853637.456366:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c242580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:11368:x1874700136416128:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787853637.456390:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853637.456415:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb05525f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2189 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853637.456526:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787853637.456654:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb05525f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2189 expref: 21 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.456730:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992761dc9f00) 00010000:00010000:2.0:1787853637.456745:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787853637.456752:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb05525f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2189 expref: 21 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.456768:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71a00, rc 0) 00000100:00100000:2.0:1787853637.456852:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c242580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+20:11368:x1874700136416128:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 487us (725us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1787853637.456859:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 144 00000100:00100000:2.0:1787853637.460986:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853637.462399:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136416384 00000100:00100000:1.0:1787853637.462410:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136416384 00000100:00100000:1.0:1787853637.462574:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:1.0:1787853637.462586:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+20:11368:x1874700136416384:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:1.0:1787853637.462849:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+21:11368:x1874700136416384:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 265us (1869us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1787853637.462857:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 37 00010000:00010000:1.0:1787853637.510696:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853637.577565:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853637.578571:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136416512 00000100:00100000:0.0:1787853637.578583:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136416512 00000100:00100000:0.0:1787853637.578653:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 145 00000100:00100000:0.0:1787853637.578663:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c241680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+21:11374:x1874700136416512:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787853637.578850:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853637.578870:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb05526d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2190 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.578941:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055274 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.578959:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.578970:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853637.579023:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787853637.579027:0:7618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853637.579048:0:7618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.579073:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb05526d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2190 expref: 23 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.579102:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055274 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2190 expref: 22 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.579110:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:0.0:1787853637.579113:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787853637.579117:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a8600, rc 0) 00000100:00100000:0.0:1787853637.579186:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c241680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:11374:x1874700136416512:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 525us (1630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853637.579192:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 145 00000100:00100000:3.0:1787853637.583161:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853637.583422:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136416768 00000100:00100000:2.0:1787853637.583432:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136416768 00000100:00100000:2.0:1787853637.583484:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 146 00000100:00100000:2.0:1787853637.583493:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:11374:x1874700136416768:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787853637.583511:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853637.583530:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb05527b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2197 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.583625:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb055282 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.583638:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb055282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.583650:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb055282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853637.583659:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787853637.584013:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb05527b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2197 expref: 25 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.584053:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb055282 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2197 expref: 24 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.584062:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cdd900) 00010000:00010000:2.0:1787853637.584064:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853637.584068:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71a00, rc 0) 00000100:00100000:2.0:1787853637.584177:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+24:11374:x1874700136416768:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 684us (1024us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1787853637.584185:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 146 00000100:00100000:2.0:1787853637.603371:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853637.603476:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853637.603519:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136416896 00000100:00100000:0.0:1787853637.603539:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136416896 00000100:00100000:0.0:1787853637.603649:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:0.0:1787853637.603661:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+24:2362:x1874700136416896:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853637.603725:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853637.603761:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb055282 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2197 expref: 24 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.603790:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cdd900) 00000100:00100000:1.0:1787853637.603816:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136417152 00000100:00100000:1.0:1787853637.603826:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136417152 00010000:00010000:0.0:1787853637.604059:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853637.604356:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+24:2362:x1874700136416896:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 695us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853637.604365:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:0.0:1787853637.606428:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 147 00000100:00100000:0.0:1787853637.606451:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+23:11374:x1874700136417152:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787853637.606482:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853637.606509:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055290 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd219e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.606633:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055297 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.606651:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055297 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.606665:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055297 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853637.606743:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787853637.607384:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055290 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd219e expref: 26 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.607409:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055297 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd219e expref: 25 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.607418:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cdd900) 00010000:00010000:0.0:1787853637.607421:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787853637.607426:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a8e00, rc 0) 00000100:00100000:0.0:1787853637.607512:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+25:11374:x1874700136417152:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1069us (4036us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1787853637.607522:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 147 00000100:00100000:2.0:1787853637.614506:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853637.614756:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136417280 00000100:00100000:0.0:1787853637.614770:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136417280 00000100:00100000:0.0:1787853637.614855:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:0.0:1787853637.614866:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2364:x1874700136417280:12345-192.168.206.10@tcp:1:lfs.0 00010000:00010000:0.0:1787853637.614929:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b692630/0xcf1365f7cb0552a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.614954:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000034748a21/0xcf1365f7cb055258 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2182 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.614964:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853637.614970:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787853637.614976:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b692630/0xcf1365f7cb0552a5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.615043:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000034748a21/0xcf1365f7cb055258 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2182 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.615059:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000034748a21/0xcf1365f7cb055258 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2182 expref: 6 pid: 6671 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853637.615089:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bf5f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6673:1874700152149248:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787853637.615947:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff992766048cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853637.623042:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bf5f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6673:1874700152149248:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787853637.623100:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b692630/0xcf1365f7cb0552a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853637.624145:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853637.624309:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136417408 00000100:00100000:0.0:1787853637.624319:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136417408 00002000:00100000:0.0:1787853637.624384:0:6677:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff99276dd36940 x1874700136417408/t0(0) o4->0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp:58/0 lens 504/0 e 0 to 0 dl 1787853648 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787853637.624397:0:6677:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99276dd36940 with x1874700136417408 ext(0->12) 00010000:00010000:0.0:1787853637.624407:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000034748a21/0xcf1365f7cb055258 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2182 expref: 7 pid: 6671 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.624425:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000034748a21/0xcf1365f7cb055258 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2182 expref: 7 pid: 6671 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853637.624433:0:6677:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99276dd36940 00000100:00100000:0.0:1787853637.624467:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:0.0:1787853637.624478:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd36940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2365:x1874700136417408:12345-192.168.206.10@tcp:4:lfs.0 00000100:00100000:0.0:1787853637.625369:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd36940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:2365:x1874700136417408:12345-192.168.206.10@tcp:4:lfs.0 Request processed in 886us (1234us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787853637.625390:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00002000:00100000:0.0:1787853637.625402:0:6677:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff99276dd36940 x1874700136417408/t4294967305(0) o4->0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp:58/0 lens 504/448 e 0 to 0 dl 1787853648 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787853637.625412:0:6677:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99276dd36940 with x1874700136417408 ext(0->12) 00010000:00010000:0.0:1787853637.625421:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000034748a21/0xcf1365f7cb055258 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2182 expref: 9 pid: 6671 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.625437:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000034748a21/0xcf1365f7cb055258 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2182 expref: 9 pid: 6671 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853637.625444:0:6677:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99276dd36940 00000100:00100000:1.0:1787853637.636350:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853637.636503:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136417536 00000100:00100000:0.0:1787853637.636516:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136417536 00010000:00010000:0.0:1787853637.636572:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000034748a21/0xcf1365f7cb055258 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2182 expref: 9 pid: 6671 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853637.636628:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00100000:0.0:1787853637.636639:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c240000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:2363:x1874700136417536:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853637.636658:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787853637.636716:0:5809:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787853637.636720:0:5809:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787853637 00002000:00010000:0.0:1787853637.636722:0:5809:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787853637 00002000:00010000:0.0:1787853637.636724:0:5809:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787853637 00010000:00010000:0.0:1787853637.636731:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000034748a21/0xcf1365f7cb055258 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2182 expref: 9 pid: 6671 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.636770:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000034748a21/0xcf1365f7cb055258 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2182 expref: 9 pid: 6671 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.636870:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034748a21/0xcf1365f7cb055258 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2182 expref: 9 pid: 6671 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.636891:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787853637.636896:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787853637.636903:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b692630/0xcf1365f7cb0552a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.636915:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b692630/0xcf1365f7cb0552a5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.636955:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853637.637037:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c240000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2363:x1874700136417536:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 400us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853637.637046:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 63 00010000:00010000:2.0:1787853637.637244:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b692630/0xcf1365f7cb0552a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.637255:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b692630/0xcf1365f7cb0552a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.637285:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b692630/0xcf1365f7cb0552a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.637302:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b692630/0xcf1365f7cb0552a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.637310:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b692630/0xcf1365f7cb0552a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.637318:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a9600 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853637.637322:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b692630/0xcf1365f7cb0552a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.637332:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b692630/0xcf1365f7cb0552a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.637345:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b692630/0xcf1365f7cb0552a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.637352:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b692630/0xcf1365f7cb0552a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853637.637425:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2364:x1874700136417280:12345-192.168.206.10@tcp:1:lfs.0 Request processed in 22560us (22931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853637.637434:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:3.0:1787853637.640583:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853637.640912:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136417792 00000100:00100000:2.0:1787853637.640924:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136417792 00000100:00100000:2.0:1787853637.640985:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:2.0:1787853637.641014:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274f705450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+25:11374:x1874700136417792:12345-192.168.206.10@tcp:35:lfs.0 00000004:00010000:2.0:1787853637.641504:0:5827:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055297 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd219e expref: 25 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787853637.643372:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1787853637.644600:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1787853637.646903:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1787853637.647008:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0552ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.647046:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055243 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2174 expref: 29 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.647057:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0552ac lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.647121:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055243 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2174 expref: 29 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.647147:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055243 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2174 expref: 29 pid: 5824 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853637.647165:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dd35a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5827:1874700152149376:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787853637.647284:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927609450c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853637.655568:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dd35a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5827:1874700152149376:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787853637.655613:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0552ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853637.656141:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853637.656214:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136417920 00000100:00100000:0.0:1787853637.656223:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136417920 00010000:00010000:0.0:1787853637.656267:0:8433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055243 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2174 expref: 30 pid: 5824 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853637.656338:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 64 00000100:00100000:0.0:1787853637.656351:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274415fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+30:2365:x1874700136417920:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853637.656376:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853637.656385:0:8433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055243 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2174 expref: 30 pid: 5824 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.656400:0:8433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055243 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2174 expref: 30 pid: 5824 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.656429:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055243 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2174 expref: 30 pid: 5824 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.656450:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cdd900) 00010000:00010000:0.0:1787853637.656456:0:8433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0552ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.656466:0:8433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0552ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.656476:0:8433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0552ac lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.656504:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853637.656566:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274415fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+29:2365:x1874700136417920:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 217us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853637.656575:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 64 00010000:00010000:0.0:1787853637.656639:0:5827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0552ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.656654:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0552ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787853637.656860:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1787853637.657113:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1787853637.657236:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bf5f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5827:1874700152149504:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787853637.657288:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853637.657319:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0600 going to sleep for 11 seconds 00000100:00100000:1.0:1787853637.657637:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152149504 00000100:00100000:1.0:1787853637.657644:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152149504 00000100:00100000:1.0:1787853637.657733:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787853637.657743:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5827:x1874700152149504:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787853637.657840:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5827:x1874700152149504:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 98us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853637.657848:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787853637.659120:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853637.659219:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bf5f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5827:1874700152149504:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787853637.660659:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1787853637.661109:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bf5f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5827:1874700152149632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787853637.661201:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853637.661240:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff992766048540 going to sleep for 11 seconds 00000100:00100000:1.0:1787853637.661431:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152149632 00000100:00100000:1.0:1787853637.661440:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152149632 00000100:00100000:1.0:1787853637.661506:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787853637.661515:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c203840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5827:x1874700152149632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787853637.661992:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c203840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5827:x1874700152149632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 476us (789us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787853637.662001:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787853637.662338:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bf5f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5827:1874700152149632:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787853637.662417:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1787853637.662468:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0552ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.662480:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0552ac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.662501:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0552ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.662508:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853637.662513:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0552ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.662523:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0552ac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.662543:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cdd900) 00010000:00010000:3.0:1787853637.662546:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787853637.662553:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0552ac lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.662560:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0552ac lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787853637.662960:0:5827:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787853637.663305:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1787853637.663319:0:5827:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 331960645293ns, next at 332960642884ns, rc = 0 00000001:00080000:3.0:1787853637.663327:0:5827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1787853637.663371:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cdd900) 00010000:00010000:3.0:1787853637.663375:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787853637.663385:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055297 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd219e expref: 33 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853637.663530:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274f705450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+32:11374:x1874700136417792:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 22518us (22960us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1787853637.663556:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 38 00000020:00080000:3.0:1787853637.663562:0:5827:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787853637.666096:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853637.666456:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136418048 00000100:00100000:3.0:1787853637.666469:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136418048 00000100:00100000:3.0:1787853637.666579:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 148 00000100:00100000:3.0:1787853637.666591:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c2412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+32:11374:x1874700136418048:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787853637.666619:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853637.666647:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0552b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd21a5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.666769:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0552b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21a5 expref: 33 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.666787:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0552b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21a5 expref: 33 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853637.666823:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:3.0:1787853637.666827:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787853637.666831:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064c200, rc 0) 00000100:00100000:3.0:1787853637.666954:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c2412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+33:11374:x1874700136418048:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 365us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853637.666962:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 148 00000100:00100000:1.0:1787853637.670626:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853637.671004:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136418304 00000100:00100000:3.0:1787853637.671018:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136418304 00000100:00100000:3.0:1787853637.671100:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:3.0:1787853637.671111:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+33:11374:x1874700136418304:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787853637.671447:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+34:11374:x1874700136418304:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 336us (831us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1787853637.671456:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:1.0:1787853637.751249:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853637.751432:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136418560 00000100:00100000:3.0:1787853637.751445:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136418560 00000100:00100000:2.0:1787853637.753383:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 149 00000100:00100000:2.0:1787853637.753400:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+34:11384:x1874700136418560:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787853637.753435:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853637.753464:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd21ac expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853637.753640:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787853637.753844:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552ba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21ac expref: 36 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.753863:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992761dc9f00) 00010000:00010000:2.0:1787853637.753867:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787853637.753873:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21ac expref: 36 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.753892:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71000, rc 0) 00000100:00100000:2.0:1787853637.753970:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+35:11384:x1874700136418560:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 575us (2734us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1787853637.753978:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 149 00000100:00100000:1.0:1787853637.762187:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853637.762343:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136418688 00000100:00100000:2.0:1787853637.762356:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136418688 00000100:00100000:2.0:1787853637.762433:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 150 00000100:00100000:2.0:1787853637.762446:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+35:11384:x1874700136418688:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:2.0:1787853637.762552:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.762575:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.762593:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.762612:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0552cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.762633:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0552cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.762641:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0552cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.762813:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb0552d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.762824:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb0552d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.762831:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb0552d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787853637.762884:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb0552d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.762899:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.762907:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.762915:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.762922:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853637.762926:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.762935:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.762959:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:2.0:1787853637.762962:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853637.762968:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.762974:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.762991:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0552cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.762998:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0552cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.763004:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0552cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.763010:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853637.763013:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0552cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.763019:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0552cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.763027:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff992743be3800) 00010000:00010000:2.0:1787853637.763029:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853637.763032:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0552cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.763037:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0552cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.763066:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb0552d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.763073:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb0552d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.763091:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb0552d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.763097:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853637.763101:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb0552d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.763108:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb0552d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.763116:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:2.0:1787853637.763118:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853637.763121:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb0552d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.763138:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb0552d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853637.763234:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+35:11384:x1874700136418688:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 790us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853637.763244:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 150 00000100:00100000:1.0:1787853637.765419:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853637.766246:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136418944 00000100:00100000:3.0:1787853637.766260:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136418944 00000100:00100000:3.0:1787853637.766332:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:3.0:1787853637.766342:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+35:11384:x1874700136418944:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787853637.766755:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+36:11384:x1874700136418944:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 412us (1360us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1787853637.766764:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:1.0:1787853637.801305:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853637.801866:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136419200 00000100:00100000:2.0:1787853637.801879:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136419200 00000100:00100000:2.0:1787853637.801982:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 151 00000100:00100000:2.0:1787853637.802009:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+36:11387:x1874700136419200:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787853637.802040:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853637.802064:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb0552dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd21b3 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802182:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0552e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802200:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0552e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802214:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0552e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802232:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802239:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802246:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802414:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0552f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802423:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0552f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802430:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0552f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853637.802453:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787853637.802561:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0552e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802569:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0552e4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802577:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0552e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802583:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853637.802588:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0552e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802597:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0552e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802623:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:2.0:1787853637.802626:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853637.802631:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0552e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802637:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0552e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802654:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802661:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802802:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802808:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853637.802811:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802818:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802827:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff992743be3800) 00010000:00010000:2.0:1787853637.802829:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853637.802832:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802838:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb0552eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802887:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb0552dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21b3 expref: 39 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802904:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0552f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21b3 expref: 38 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853637.802912:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:2.0:1787853637.802915:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853637.802918:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70400, rc 0) 00000100:00100000:2.0:1787853637.803000:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+38:11387:x1874700136419200:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 993us (1710us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787853637.803018:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 151 00000100:00100000:1.0:1787853637.807943:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853637.808419:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136419328 00000100:00100000:0.0:1787853637.808432:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136419328 00000100:00100000:0.0:1787853637.808511:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 152 00000100:00100000:0.0:1787853637.808522:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+38:11387:x1874700136419328:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:0.0:1787853637.808611:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055300 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.808633:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.808647:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.808712:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.808736:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055300 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.808743:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.808750:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853637.808755:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.808764:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055300 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.808780:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:0.0:1787853637.808783:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787853637.808789:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055300 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853637.808796:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055300 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853637.808908:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+38:11387:x1874700136419328:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 386us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853637.808918:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 152 00000100:00100000:1.0:1787853637.811246:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853637.811334:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136419584 00000100:00100000:3.0:1787853637.811345:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136419584 00000100:00100000:3.0:1787853637.811410:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:3.0:1787853637.811442:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+38:11387:x1874700136419584:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787853637.811739:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+39:11387:x1874700136419584:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 318us (502us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787853637.811746:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:1.0:1787853638.045661:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853638.045952:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136419840 00000100:00100000:3.0:1787853638.045965:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136419840 00000100:00100000:3.0:1787853638.046043:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 153 00000100:00100000:3.0:1787853638.046054:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+39:11418:x1874700136419840:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:3.0:1787853638.046100:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853638.046129:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055307 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd21ba expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.046281:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb05530e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.046298:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb05530e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.046312:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb05530e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853638.046325:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787853638.046910:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055307 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21ba expref: 42 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.046933:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb05530e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21ba expref: 41 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.046943:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:3.0:1787853638.046947:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853638.046951:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064d000, rc 0) 00000100:00100000:3.0:1787853638.047096:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+41:11418:x1874700136419840:12345-192.168.206.10@tcp:101:cat.0 Request processed in 1043us (1448us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1787853638.047105:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 153 00000100:00100000:1.0:1787853638.050781:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853638.050863:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136420096 00000100:00100000:3.0:1787853638.050876:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136420096 00000100:00100000:1.0:1787853638.050880:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853638.050948:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136420224 00000100:00100000:0.0:1787853638.050953:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136420224 00000100:00100000:3.0:1787853638.051183:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:3.0:1787853638.051199:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775483c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+42:11418:x1874700136420096:12345-192.168.206.10@tcp:35:cat.0 00000100:00100000:3.0:1787853638.051892:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775483c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+43:11418:x1874700136420096:12345-192.168.206.10@tcp:35:cat.0 Request processed in 694us (1122us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787853638.051919:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:0.0:1787853638.051940:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:0.0:1787853638.051950:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775481a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+42:2363:x1874700136420224:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853638.051964:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853638.052018:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb05530e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21ba expref: 42 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.052042:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:0.0:1787853638.052047:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853638.052069:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775481a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+41:2363:x1874700136420224:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 121us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853638.052087:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:1.0:1787853638.104488:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853638.105144:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136420480 00000100:00100000:0.0:1787853638.105158:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136420480 00000100:00100000:0.0:1787853638.105284:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 154 00000100:00100000:0.0:1787853638.105296:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daf2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+41:11424:x1874700136420480:12345-192.168.206.10@tcp:101:dd.0 00010000:00010000:0.0:1787853638.105325:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853638.105328:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787853638.105360:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055274 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2190 expref: 41 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.105384:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:0.0:1787853638.105390:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853638.105417:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb05531c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd21c1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.105544:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055323 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.105561:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0552f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21b3 expref: 41 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.105587:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055323 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.105632:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0552f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21b3 expref: 41 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.105650:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0552f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21b3 expref: 41 pid: 7618 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853638.105666:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa2a580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5826:1874700152149760:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787853638.105841:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d8b9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787853638.109431:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa2a580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5826:1874700152149760:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787853638.109469:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055323 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853638.117519:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853638.117730:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136420608 00000100:00100000:0.0:1787853638.117743:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136420608 00010000:00010000:0.0:1787853638.117798:0:8433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0552f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21b3 expref: 42 pid: 7618 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853638.117845:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:0.0:1787853638.117858:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daf1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+42:2365:x1874700136420608:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853638.117880:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853638.117887:0:8433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0552f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21b3 expref: 42 pid: 7618 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.117927:0:8433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0552f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21b3 expref: 42 pid: 7618 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.117958:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb0552f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21b3 expref: 42 pid: 7618 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.117983:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:0.0:1787853638.117990:0:8433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055323 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.118000:0:8433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055323 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.118010:0:8433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055323 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.118048:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853638.118359:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055323 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.118369:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055323 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853638.118392:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787853638.118603:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb05531c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21c1 expref: 43 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.118622:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055323 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21c1 expref: 42 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.118631:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:2.0:1787853638.118634:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787853638.118636:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a9400, rc 0) 00000100:00100000:2.0:1787853638.119725:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daf2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+42:11424:x1874700136420480:12345-192.168.206.10@tcp:101:dd.0 Request processed in 14421us (15240us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787853638.119739:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 154 00000100:00100000:0.0:1787853638.119885:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daf1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+41:2365:x1874700136420608:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 2028us (2379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853638.119896:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:1.0:1787853638.124449:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853638.124553:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136420864 00000100:00100000:3.0:1787853638.124567:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136420864 00000100:00100000:3.0:1787853638.124884:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 155 00000100:00100000:3.0:1787853638.124899:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daf0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+41:11424:x1874700136420864:12345-192.168.206.10@tcp:36:dd.0 00010000:00010000:3.0:1787853638.125247:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055331 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.125269:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055331 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.125282:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055331 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787853638.125342:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1787853638.125369:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c3ccde0 reply state 00000000fe232546 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055331 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853638.125379:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787853638.125500:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daf0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+44:11424:x1874700136420864:12345-192.168.206.10@tcp:36:dd.0 Request processed in 605us (1064us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1787853638.125509:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 155 00000020:00080000:3.0:1787853638.125515:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787853638.127422:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055331 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.127443:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055331 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.127451:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055331 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.127478:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853638.127484:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055331 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.127493:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055331 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.127513:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:2.0:1787853638.127517:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853638.127522:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055331 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.127529:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb055331 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853638.330951:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853638.331048:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136420992 00000100:00100000:3.0:1787853638.331059:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136420992 00000100:00100000:3.0:1787853638.331144:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 156 00000100:00100000:3.0:1787853638.331157:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daf2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+43:11438:x1874700136420992:12345-192.168.206.10@tcp:101:stat.0 00010000:00010000:3.0:1787853638.331191:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853638.331239:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb055338 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd21c8 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.331328:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb05533f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.331345:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb05533f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.331360:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb05533f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.331378:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb055346 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.331386:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb055346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.331393:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb055346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.331518:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb05534d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.331531:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055323 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21c1 expref: 44 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.331540:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb05534d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.331581:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055323 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21c1 expref: 44 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.332081:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055323 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21c1 expref: 44 pid: 5826 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853638.332100:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5825:1874700152149888:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787853638.332275:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff992766048540 going to sleep for 11 seconds 00000100:00100000:0.0:1787853638.337338:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5825:1874700152149888:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787853638.337339:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00010000:00010000:0.0:1787853638.337635:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb05534d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853638.338004:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136421248 00000100:00100000:1.0:1787853638.338015:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136421248 00000100:00100000:1.0:1787853638.338100:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:1.0:1787853638.338113:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+45:5599:x1874700136421248:12345-192.168.206.10@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787853638.338802:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+46:5599:x1874700136421248:12345-192.168.206.10@tcp:35:ldlm_bl.0 Request processed in 689us (1474us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1787853638.338812:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:1.0:1787853638.344836:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853638.345007:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136421376 00000100:00100000:2.0:1787853638.345019:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136421376 00010000:00010000:2.0:1787853638.345071:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055323 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21c1 expref: 46 pid: 5826 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853638.345241:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:2.0:1787853638.345254:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daf1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+46:2364:x1874700136421376:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853638.345273:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853638.345281:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055323 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21c1 expref: 46 pid: 5826 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.345296:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055323 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21c1 expref: 46 pid: 5826 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.345342:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055323 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21c1 expref: 46 pid: 5826 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.345363:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:2.0:1787853638.345368:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb05534d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.345378:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb05534d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.345386:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb05534d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.345427:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853638.345506:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daf1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+45:2364:x1874700136421376:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 255us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853638.345515:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 66 00010000:00010000:3.0:1787853638.345583:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb05534d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.345592:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb05534d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853638.345648:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787853638.345654:0:5825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853638.345717:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb05534d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.345732:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb05534d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.345742:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb05533f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.345750:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb05533f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.345757:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb05533f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.345763:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853638.345775:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb05533f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.345784:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb05533f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.345793:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:3.0:1787853638.345797:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853638.345801:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb05533f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.345808:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb05533f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.345821:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb055346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.345827:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb055346 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.345832:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb055346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.345837:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c6800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853638.345839:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb055346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.345845:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb055346 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.345852:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff992742cdd900) 00010000:00010000:3.0:1787853638.345854:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853638.345863:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb055346 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.345870:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb055346 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.345913:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb055338 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21c8 expref: 45 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.345928:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb05534d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21c8 expref: 44 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.345936:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:3.0:1787853638.345938:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853638.345941:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927821c7800, rc 0) 00000100:00100000:3.0:1787853638.345972:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daf2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+44:11438:x1874700136420992:12345-192.168.206.10@tcp:101:stat.0 Request processed in 14819us (15035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853638.345981:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 156 00000100:00100000:2.0:1787853638.424148:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853638.424273:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136421632 00000100:00100000:0.0:1787853638.424285:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136421632 00000100:00100000:0.0:1787853638.424360:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 157 00000100:00100000:0.0:1787853638.424371:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+44:11444:x1874700136421632:12345-192.168.206.10@tcp:36:truncate.0 00010000:00010000:0.0:1787853638.424471:0:7618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853638.424771:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb05534d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21c8 expref: 44 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.424798:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:0.0:1787853638.424804:0:7618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853638.425097:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055354 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.425114:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055354 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.425126:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055354 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787853638.425187:0:7618:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1787853638.425214:0:7618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d792cf93 reply state 0000000015c6a687 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055354 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853638.425224:0:7618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787853638.425333:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+46:11444:x1874700136421632:12345-192.168.206.10@tcp:36:truncate.0 Request processed in 963us (1198us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787853638.425342:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 157 00000020:00080000:0.0:1787853638.425348:0:7618:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787853638.426944:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055354 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.426974:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055354 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.426982:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055354 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.427004:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853638.427009:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055354 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.427017:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055354 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.427036:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:0.0:1787853638.427039:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853638.427044:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055354 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.427050:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055354 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.534264:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787853638.537968:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000020:00080000:3.0:1787853638.537994:0:5846:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99276e832a80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1787853638.537999:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99276604bd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99276e832900 00000020:00080000:3.0:1787853638.538003:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff992766014e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff992760804000 00000004:00080000:3.0:1787853638.538091:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787853638.538266:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1787853638.538488:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1787853638.538753:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dd35a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152150016:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787853638.538843:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853638.539062:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152150016 00000100:00100000:2.0:1787853638.539086:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152150016 00000100:00100000:2.0:1787853638.539151:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787853638.539161:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99275aa2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3298:x1874700152150016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787853638.539193:0:6672:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1787853638.539237:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a907b45, atime: 0x6a907b45, ctime: 0x6a907b45, blocks: 0x1 00010000:00010000:2.0:1787853638.539247:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edee793e/0xcf1365f7cb05535b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.539287:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=332s v=(0 0) 00010000:00010000:2.0:1787853638.539291:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853638.539299:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edee793e/0xcf1365f7cb05535b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.539318:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edee793e/0xcf1365f7cb05535b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.539329:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edee793e/0xcf1365f7cb05535b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.539336:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edee793e/0xcf1365f7cb05535b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.539399:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787853638.540025:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99275aa2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3298:x1874700152150016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 862us (1179us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787853638.540036:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:0.0:1787853638.540443:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99276dd35a40/2, rc 0, transno 4294967307 00000100:00100000:0.0:1787853638.540451:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dd35a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152150016:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787853638.541346:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853638.541361:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edee793e/0xcf1365f7cb05535b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.541377:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71000 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:1.0:1787853638.541383:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edee793e/0xcf1365f7cb05535b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.541394:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edee793e/0xcf1365f7cb05535b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.541420:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edee793e/0xcf1365f7cb05535b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.541428:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edee793e/0xcf1365f7cb05535b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.541456:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853638.541458:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853638.541460:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853638.603303:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853638.603426:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136421760 00000100:00100000:0.0:1787853638.603439:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136421760 00000100:00100000:0.0:1787853638.603513:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 158 00000100:00100000:0.0:1787853638.603524:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761f48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+15:11458:x1874700136421760:12345-192.168.206.10@tcp:101:stat.0 00010000:00010000:0.0:1787853638.603555:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853638.603582:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055362 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd21cf expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.603666:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055369 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.603742:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055369 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.603756:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055369 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.603773:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb055370 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.603787:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb055370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.603795:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb055370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.604287:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055377 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.604297:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.604305:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853638.604356:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787853638.604361:0:5826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853638.604391:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.604404:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055377 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.604424:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055369 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.604430:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055369 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.604437:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055369 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.604442:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853638.604447:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055369 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.604455:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055369 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.604469:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:0.0:1787853638.604471:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853638.604476:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055369 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.604482:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055369 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.604496:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb055370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.604502:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb055370 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.604507:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb055370 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.604517:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a9200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853638.604520:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb055370 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.604526:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb055370 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.604534:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff992761dc9d00) 00010000:00010000:0.0:1787853638.604536:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853638.604921:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb055370 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.604931:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb055370 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.604978:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055362 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21cf expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.604993:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055377 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21cf expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.605000:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:0.0:1787853638.605003:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853638.605006:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a8a00, rc 0) 00000100:00100000:0.0:1787853638.605099:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761f48780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+16:11458:x1874700136421760:12345-192.168.206.10@tcp:101:stat.0 Request processed in 1576us (1810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853638.605108:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 158 00000100:00100000:1.0:1787853638.702047:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853638.702888:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136422016 00000100:00100000:3.0:1787853638.702902:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136422016 00000100:00100000:3.0:1787853638.702989:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 159 00000100:00100000:3.0:1787853638.703001:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daf03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+16:11468:x1874700136422016:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787853638.703027:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853638.703139:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb05537e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd21d6 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853638.704566:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787853638.705582:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb05537e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21d6 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.705877:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992761dc9f00) 00010000:00010000:2.0:1787853638.705880:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787853638.706164:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb05537e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21d6 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.706183:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927821c6800, rc 0) 00000100:00100000:2.0:1787853638.706350:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daf03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+17:11468:x1874700136422016:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 3350us (4315us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787853638.706360:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 159 00000100:00100000:1.0:1787853638.712319:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853638.712607:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136422272 00000100:00100000:0.0:1787853638.712636:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136422272 00000100:00100000:0.0:1787853638.713033:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:0.0:1787853638.713046:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274f707850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+17:11468:x1874700136422272:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:0.0:1787853638.713624:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274f707850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+18:11468:x1874700136422272:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 580us (1318us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787853638.713633:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:1.0:1787853638.812830:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853638.812951:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136422528 00000100:00100000:3.0:1787853638.812963:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136422528 00000100:00100000:3.0:1787853638.813037:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 160 00000100:00100000:3.0:1787853638.813048:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daf0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+18:11474:x1874700136422528:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787853638.813249:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853638.813278:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb05538c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd21dd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.813437:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055393 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.813454:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055377 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21cf expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.813463:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055393 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.813568:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055377 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21cf expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.813584:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055377 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21cf expref: 19 pid: 5826 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853638.813599:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5825:1874700152150144:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787853638.814286:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff992766048480 going to sleep for 11 seconds 00000100:00100000:3.0:1787853638.820635:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5825:1874700152150144:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787853638.820723:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055393 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853638.821886:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853638.822628:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136422656 00000100:00100000:2.0:1787853638.822641:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136422656 00010000:00010000:2.0:1787853638.822730:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055377 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21cf expref: 20 pid: 5826 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853638.822782:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 67 00000100:00100000:2.0:1787853638.822794:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daf3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+20:2364:x1874700136422656:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853638.822812:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853638.822820:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055377 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21cf expref: 20 pid: 5826 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.822835:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055377 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21cf expref: 20 pid: 5826 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.822864:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055377 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21cf expref: 20 pid: 5826 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.822884:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:2.0:1787853638.822891:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055393 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.822920:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055393 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.822929:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055393 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.823166:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853638.823297:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daf3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:2364:x1874700136422656:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 504us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853638.823306:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 67 00010000:00010000:3.0:1787853638.824500:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055393 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.824525:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055393 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853638.824552:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1787853638.824806:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb05538c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21dd expref: 20 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.824829:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055393 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21dd expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.824840:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:3.0:1787853638.824843:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787853638.824847:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927821c7800, rc 0) 00000100:00100000:3.0:1787853638.824905:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daf0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:11474:x1874700136422528:12345-192.168.206.10@tcp:101:bash.0 Request processed in 11860us (12162us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1787853638.824914:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 160 00000100:00100000:1.0:1787853638.832478:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853638.832902:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136422912 00000100:00100000:0.0:1787853638.832915:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136422912 00000100:00100000:0.0:1787853638.832994:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 161 00000100:00100000:0.0:1787853638.833007:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:11474:x1874700136422912:12345-192.168.206.10@tcp:36:bash.0 00010000:00010000:0.0:1787853638.833545:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0553a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.833570:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0553a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.833586:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0553a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787853638.833646:0:7618:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1787853638.834006:0:7618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b77c4351 reply state 000000000ea3e7c6 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0553a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853638.834016:0:7618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787853638.839063:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:11474:x1874700136422912:12345-192.168.206.10@tcp:36:bash.0 Request processed in 6045us (6584us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1787853638.839088:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 161 00000020:00080000:1.0:1787853638.839096:0:7618:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787853638.847939:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853638.848243:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136423040 00000100:00100000:0.0:1787853638.848255:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136423040 00000100:00100000:0.0:1787853638.848330:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 162 00000100:00100000:0.0:1787853638.848341:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:11474:x1874700136423040:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787853638.848372:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853638.848424:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb0553a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd21e4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.848528:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb0553af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.848546:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055393 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21dd expref: 23 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.848555:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0553a1 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.848562:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb0553af lrc: 5/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.848583:0:5826:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0553a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.848614:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055393 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21dd expref: 23 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.848630:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055393 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21dd expref: 23 pid: 5825 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853638.848645:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99275aa283c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5826:1874700152150272:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787853638.848911:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0553a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.848921:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0553a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.848928:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0553a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.848934:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853638.848938:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0553a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.848946:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0553a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.848963:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:2.0:1787853638.848967:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853638.848970:0:3283:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb0553af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.848992:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0553a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.848998:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0553a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853638.852419:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d55b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787853638.854113:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853638.854226:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99275aa283c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5826:1874700152150272:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787853638.854259:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb0553af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853638.854371:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136423168 00000100:00100000:0.0:1787853638.854380:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136423168 00010000:00010000:0.0:1787853638.854428:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055393 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21dd expref: 23 pid: 5825 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853638.854496:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:0.0:1787853638.854507:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daf12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+23:2364:x1874700136423168:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853638.854527:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853638.854536:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055393 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21dd expref: 23 pid: 5825 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.854549:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055393 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21dd expref: 23 pid: 5825 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.854576:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb055393 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21dd expref: 23 pid: 5825 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.854596:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:0.0:1787853638.854601:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb0553af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.854611:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb0553af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.854619:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb0553af lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.854648:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853638.854978:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daf12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:2364:x1874700136423168:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 470us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853638.854988:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 68 00010000:00010000:1.0:1787853638.855052:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb0553af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.855061:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb0553af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853638.855128:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787853638.855133:0:5826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853638.855159:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb0553af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.855198:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb0553a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21e4 expref: 22 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.855215:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb0553af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21e4 expref: 21 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.855224:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:1.0:1787853638.855227:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787853638.855229:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a8000, rc 0) 00000100:00100000:1.0:1787853638.855265:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+21:11474:x1874700136423040:12345-192.168.206.10@tcp:101:bash.0 Request processed in 6926us (7340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853638.855273:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 162 00000100:00100000:3.0:1787853638.861209:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853638.861312:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136423424 00000100:00100000:1.0:1787853638.861324:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136423424 00000100:00100000:1.0:1787853638.861393:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:1.0:1787853638.861404:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+21:11474:x1874700136423424:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:1.0:1787853638.861980:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:11474:x1874700136423424:12345-192.168.206.10@tcp:35:bash.0 Request processed in 342us (550us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787853638.861992:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:3.0:1787853638.942506:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853638.943034:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136423680 00000100:00100000:2.0:1787853638.943046:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136423680 00000100:00100000:2.0:1787853638.943172:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 163 00000100:00100000:2.0:1787853638.943185:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:11484:x1874700136423680:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787853638.943218:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853638.943245:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0553b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd21eb expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853638.943603:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787853638.943840:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0553b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21eb expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.943857:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992761dc9f00) 00010000:00010000:2.0:1787853638.943860:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787853638.943867:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0553b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21eb expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853638.943896:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70e00, rc 0) 00000100:00100000:2.0:1787853638.943980:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+23:11484:x1874700136423680:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 797us (1489us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1787853638.943989:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 163 00000100:00100000:2.0:1787853638.947860:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853638.947938:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136423808 00000100:00100000:3.0:1787853638.947952:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136423808 00000100:00100000:3.0:1787853638.948065:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 164 00000100:00100000:3.0:1787853638.948090:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761f4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+23:11484:x1874700136423808:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:3.0:1787853638.948210:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb0553c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948231:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb0553c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948244:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb0553c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948262:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb0553cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948269:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb0553cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948274:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb0553cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948748:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0553d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948759:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0553d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948767:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0553d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853638.948820:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0553d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948835:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb0553c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948851:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb0553c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948859:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb0553c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948866:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c6800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853638.948870:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb0553c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948878:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb0553c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948893:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:3.0:1787853638.948896:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853638.948901:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb0553c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948908:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c6800/0xcf1365f7cb0553c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948923:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb0553cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948930:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb0553cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948935:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb0553cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948940:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c7800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853638.948950:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb0553cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948957:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb0553cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948965:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff992742cdd900) 00010000:00010000:3.0:1787853638.948968:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853638.948970:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb0553cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948977:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927821c7800/0xcf1365f7cb0553cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.948994:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0553d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.949001:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0553d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.949006:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0553d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.949011:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853638.949014:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0553d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.949020:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0553d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.949027:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:3.0:1787853638.949029:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853638.949039:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0553d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.949046:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0553d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853638.949161:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761f4a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+23:11484:x1874700136423808:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 1072us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853638.949171:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 164 00000100:00100000:3.0:1787853638.951359:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853638.951584:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136424064 00000100:00100000:1.0:1787853638.951598:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136424064 00000100:00100000:0.0:1787853638.951893:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:0.0:1787853638.951924:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+23:11484:x1874700136424064:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:0.0:1787853638.952511:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+24:11484:x1874700136424064:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 588us (1161us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1787853638.952521:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:0.0:1787853638.985317:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853638.985524:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136424320 00000100:00100000:1.0:1787853638.985538:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136424320 00000100:00100000:1.0:1787853638.985612:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 165 00000100:00100000:1.0:1787853638.985624:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99275aa283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+24:11487:x1874700136424320:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787853638.985655:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853638.988000:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0553d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd21f2 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.988394:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0553e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.988476:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0553e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.988491:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0553e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.988511:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb0553e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.988519:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb0553e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.988545:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb0553e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.989323:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0553ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.989336:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0553ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.989346:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0553ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853638.989358:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787853638.989649:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0553e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.989658:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0553e0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.989934:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0553e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.989943:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853638.989949:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0553e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.989958:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0553e0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.989974:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:1.0:1787853638.989978:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853638.989994:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0553e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.990001:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0553e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.990018:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb0553e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.990024:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb0553e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.990031:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb0553e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.990036:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853638.990040:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb0553e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.990046:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb0553e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.990055:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9927433f1000) 00010000:00010000:1.0:1787853638.990057:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853638.990061:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb0553e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.990067:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb0553e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.990378:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0553d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21f2 expref: 27 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.990506:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0553ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21f2 expref: 26 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853638.990515:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:0.0:1787853638.990518:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853638.990521:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196600, rc 0) 00000100:00100000:0.0:1787853638.990621:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99275aa283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+26:11487:x1874700136424320:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 4998us (5427us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787853638.990632:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 165 00000100:00100000:2.0:1787853638.994564:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853638.994657:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853638.994892:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136424576 00000100:00100000:3.0:1787853638.994905:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136424576 00000100:00100000:3.0:1787853638.994979:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:3.0:1787853638.994990:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761f483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+26:2362:x1874700136424576:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853638.995010:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853638.995044:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0553ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21f2 expref: 26 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853638.995068:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:3.0:1787853638.995090:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853638.995167:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761f483c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+25:2362:x1874700136424576:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 178us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853638.995176:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:1.0:1787853638.998566:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136424448 00000100:00100000:1.0:1787853638.998587:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136424448 00000100:00100000:1.0:1787853638.999177:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 166 00000100:00100000:1.0:1787853638.999207:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761f49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+25:11487:x1874700136424448:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:1.0:1787853638.999295:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb0553fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.999315:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb0553fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.999329:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb0553fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.999361:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb0553fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.999367:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb0553fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.999375:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb0553fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.999382:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853638.999386:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb0553fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.999394:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb0553fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.999408:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:1.0:1787853638.999411:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787853638.999416:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb0553fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853638.999423:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb0553fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853638.999529:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761f49a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+25:11487:x1874700136424448:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 325us (4980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853638.999538:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 166 00000100:00100000:2.0:1787853639.002437:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853639.002589:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136424832 00000100:00100000:0.0:1787853639.002600:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136424832 00000100:00100000:0.0:1787853639.002708:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00080000:1.0:1787853639.002917:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853639.002963:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761f48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+25:11487:x1874700136424832:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:0.0:1787853639.003332:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761f48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+26:11487:x1874700136424832:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 609us (906us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1787853639.003343:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:3.0:1787853639.128978:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853639.129124:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136425088 00000100:00100000:2.0:1787853639.129136:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136425088 00000100:00100000:2.0:1787853639.129205:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 167 00000100:00100000:2.0:1787853639.129215:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+26:11505:x1874700136425088:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:2.0:1787853639.129245:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853639.129269:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055403 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd21f9 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.129406:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb05540a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.129423:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb05540a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.129436:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb05540a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853639.129449:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787853639.129595:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055403 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21f9 expref: 29 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.129631:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb05540a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21f9 expref: 28 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.129640:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:2.0:1787853639.129643:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787853639.129647:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70c00, rc 0) 00000100:00100000:2.0:1787853639.129767:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+28:11505:x1874700136425088:12345-192.168.206.10@tcp:101:cat.0 Request processed in 553us (800us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1787853639.129775:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 167 00000100:00100000:2.0:1787853639.160862:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853639.161066:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136425216 00000100:00100000:0.0:1787853639.161093:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136425216 00000100:00100000:0.0:1787853639.161187:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 168 00000100:00100000:0.0:1787853639.161343:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761f4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+28:11506:x1874700136425216:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787853639.161373:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853639.161406:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055418 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2200 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.161491:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb05541f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.161506:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb05541f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.161520:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb05541f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853639.161794:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787853639.161799:0:5825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853639.161870:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb05541f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.161905:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055418 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2200 expref: 30 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.161926:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb05541f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2200 expref: 29 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.161936:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:0.0:1787853639.161939:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787853639.162186:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a9200, rc 0) 00000100:00100000:0.0:1787853639.162337:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761f4bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+29:11506:x1874700136425216:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 998us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853639.165254:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 168 00000100:00100000:1.0:1787853639.167343:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853639.167585:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136425600 00000100:00100000:3.0:1787853639.167597:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136425600 00000100:00100000:3.0:1787853639.167667:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:3.0:1787853639.167863:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daf0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+29:11506:x1874700136425600:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787853639.168815:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daf0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+30:11506:x1874700136425600:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 952us (1478us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787853639.168827:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:1.0:1787853639.171177:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853639.171300:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136425728 00000100:00100000:2.0:1787853639.171312:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136425728 00000100:00100000:2.0:1787853639.171401:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:2.0:1787853639.171414:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274415ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+30:11506:x1874700136425728:12345-192.168.206.10@tcp:103:lfs.0 00010000:00010000:2.0:1787853639.171432:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787853639.171464:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb0553af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21e4 expref: 30 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.171489:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb05540a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21f9 expref: 29 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.171503:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0552b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd21a5 expref: 28 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.171515:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992742cddb00) 00010000:00010000:2.0:1787853639.171549:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853639.171616:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274415ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+27:11506:x1874700136425728:12345-192.168.206.10@tcp:103:lfs.0 Request processed in 204us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853639.171628:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:2.0:1787853639.175043:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853639.175142:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136425856 00000100:00100000:0.0:1787853639.175155:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136425856 00000100:00100000:0.0:1787853639.175229:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 169 00000100:00100000:0.0:1787853639.175240:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761f483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+27:11506:x1874700136425856:12345-192.168.206.10@tcp:58:lfs.0 00010000:00010000:0.0:1787853639.175403:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055426 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.175424:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055426 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.175439:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055426 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787853639.177339:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1787853639.178036:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761f483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+27:11506:x1874700136425856:12345-192.168.206.10@tcp:58:lfs.0 Request processed in 2232us (2442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853639.178051:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 169 00000100:00100000:1.0:1787853639.207441:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853639.210454:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136425984 00000100:00100000:2.0:1787853639.210476:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136425984 00000100:00100000:2.0:1787853639.210568:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 170 00000100:00100000:2.0:1787853639.210580:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daf2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+27:11508:x1874700136425984:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787853639.210605:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853639.210631:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb05542d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2207 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.212044:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055434 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.212080:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055434 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.212096:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055434 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.212115:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb05543b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.212123:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb05543b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.212130:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb05543b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.215368:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055442 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.215397:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.215412:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853639.215475:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787853639.215481:0:5826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853639.215506:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.215521:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.215531:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055434 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.215538:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055434 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.215546:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055434 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.215553:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853639.215557:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055434 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.215566:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055434 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.215599:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:2.0:1787853639.215603:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853639.215609:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055434 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.215615:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055434 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.215634:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb05543b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.215640:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb05543b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.215645:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb05543b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.215651:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71a00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853639.215654:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb05543b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.215660:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb05543b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.215667:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff992743be3e00) 00010000:00010000:2.0:1787853639.215670:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853639.216885:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb05543b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.216897:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb05543b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.216980:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb05542d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2207 expref: 29 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.216998:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055442 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2207 expref: 28 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.217009:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992761dc9d00) 00010000:00010000:2.0:1787853639.217011:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853639.217015:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71c00, rc 0) 00000100:00100000:2.0:1787853639.217126:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daf2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+28:11508:x1874700136425984:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 6545us (9698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853639.217137:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 170 00000100:00100000:1.0:1787853639.494010:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787853639.494039:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276daf21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152150400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853639.494140:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853639.494233:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152150400 00000100:00100000:1.0:1787853639.494243:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152150400 00000100:00100000:1.0:1787853639.494311:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787853639.494323:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daf30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1874700152150400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787853639.494368:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853639.494418:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daf30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1874700152150400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853639.494427:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1787853639.494449:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787853639.494497:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276daf21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152150400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853639.495139:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276daf3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152150656:0@lo:400:kworker.0 00000100:00100000:1.0:1787853639.495201:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853639.495233:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787853639.495239:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276daf1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152150784:0@lo:400:kworker.0 00000100:00100000:1.0:1787853639.495265:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853639.495296:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152150656 00000100:00100000:1.0:1787853639.495302:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152150656 00000100:00100000:1.0:1787853639.495338:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152150784 00000100:00100000:1.0:1787853639.495341:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152150784 00000100:00100000:1.0:1787853639.495384:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787853639.495392:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daf3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152150656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853639.495434:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daf3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152150656:12345-0@lo:400:kworker.0 Request processed in 42us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853639.495441:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787853639.495457:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787853639.495463:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daf12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152150784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853639.495488:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daf12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152150784:12345-0@lo:400:kworker.0 Request processed in 26us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853639.495494:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:1.0:1787853639.495516:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853639.495538:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276daf1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152150784:0@lo:400:kworker.0 00000100:00100000:1.0:1787853639.495547:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276daf3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152150656:0@lo:400:kworker.0 00000100:00100000:0.0:1787853639.495631:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276daf1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152150912:0@lo:400:kworker.0 00000100:00100000:0.0:1787853639.495666:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853639.495722:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787853639.495729:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276daf21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152150528:0@lo:400:kworker.0 00000100:00100000:0.0:1787853639.495760:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853639.495781:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276daf1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152151040:0@lo:400:kworker.0 00000100:00100000:0.0:1787853639.495804:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853639.495831:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152150528 00000100:00100000:0.0:1787853639.495836:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152150528 00000100:00100000:0.0:1787853639.495865:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787853639.495871:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152150528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853639.495907:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152150528:12345-0@lo:400:kworker.0 Request processed in 36us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853639.495928:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787853639.495968:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276daf21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152150528:0@lo:400:kworker.0 00000100:00100000:0.0:1787853639.495984:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152151040 00000100:00100000:0.0:1787853639.495988:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152151040 00000100:00100000:0.0:1787853639.496015:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787853639.496020:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152151040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853639.496052:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152151040:12345-0@lo:400:kworker.0 Request processed in 32us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853639.496058:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1787853639.496088:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853639.496104:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276daf1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152151040:0@lo:400:kworker.0 00000100:00100000:1.0:1787853639.498193:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152150912 00000100:00100000:1.0:1787853639.498210:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152150912 00000100:00100000:1.0:1787853639.498283:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787853639.498296:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152150912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853639.498409:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152150912:12345-0@lo:400:kworker.0 Request processed in 116us (2741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853639.498424:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1787853639.498587:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853639.498634:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276daf1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152150912:0@lo:400:kworker.0 00010000:00010000:1.0:1787853639.561051:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787853639.625552:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787853639.625566:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787853639.625632:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1787853639.625639:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787853639.625879:0:11666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992775481a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874700152151168:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787853639.626040:0:11666:0:(client.c:2715:ptlrpc_set_wait()) set ffff992748e543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853639.631706:0:11666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992775481a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874700152151168:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787853639.632953:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853639.633029:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136426112 00000100:00100000:1.0:1787853639.633041:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136426112 00000100:00100000:1.0:1787853639.633120:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 171 00000100:00100000:1.0:1787853639.633131:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775481a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+28:11520:x1874700136426112:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787853639.633171:0:5826:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787853639.633306:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775481a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+28:11520:x1874700136426112:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 176us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853639.635654:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 171 00000100:00100000:1.0:1787853639.636944:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853639.637017:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136426240 00000100:00100000:0.0:1787853639.637030:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136426240 00000100:00100000:0.0:1787853639.637111:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 172 00000100:00100000:0.0:1787853639.637123:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daf3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+28:11520:x1874700136426240:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787853639.637232:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055449 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637251:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055449 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637265:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055449 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637370:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055450 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637380:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055450 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637387:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055450 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637422:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055457 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637432:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637438:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853639.637486:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787853639.637502:0:7618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787853639.637517:0:7618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637529:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055449 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637540:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055449 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637547:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055449 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637554:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853639.637558:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055449 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637566:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055449 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637581:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff992761dc9700) 00010000:00010000:0.0:1787853639.637584:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853639.637589:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055449 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637594:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb055449 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637604:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055450 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637609:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055450 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637614:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055450 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637618:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8a00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853639.637626:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055450 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637632:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055450 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637639:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff992761dc9900) 00010000:00010000:0.0:1787853639.637642:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853639.637645:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055450 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637652:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb055450 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637665:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637669:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055457 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637717:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055457 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637721:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a9400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853639.637724:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055457 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637729:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055457 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637737:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992761dc9d00) 00010000:00010000:0.0:1787853639.637740:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853639.637749:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055457 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.637754:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055457 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853639.637843:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daf3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+28:11520:x1874700136426240:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 Request processed in 721us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853639.637851:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 172 00000100:00100000:2.0:1787853639.647437:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853639.647479:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136426496 00000100:00100000:2.0:1787853639.647492:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136426496 00000100:00100000:2.0:1787853639.647564:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 173 00000100:00100000:2.0:1787853639.647575:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761f4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+28:11520:x1874700136426496:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853639.647608:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853639.647634:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb05545e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd220e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.647814:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055465 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.647833:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.647858:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853639.647872:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787853639.647993:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.648001:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055465 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.648007:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055465 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.648013:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853639.648017:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055465 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.648024:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055465 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.648039:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992761dc9d00) 00010000:00010000:2.0:1787853639.648042:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853639.648047:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055465 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.648053:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb055465 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.648110:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb05545e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd220e expref: 30 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.648138:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff992761dc9700) 00010000:00010000:2.0:1787853639.648141:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787853639.648145:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb05545e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd220e expref: 30 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.648155:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71a00, rc 0) 00000100:00100000:2.0:1787853639.648235:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761f4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+29:11520:x1874700136426496:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 661us (811us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1787853639.648242:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 173 00000100:00100000:1.0:1787853639.652466:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853639.652566:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136426624 00000100:00100000:0.0:1787853639.652578:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136426624 00000100:00100000:0.0:1787853639.652877:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 174 00000100:00100000:0.0:1787853639.652889:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daf1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+29:11520:x1874700136426624:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787853639.652937:0:5824:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787853639.653127:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daf1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+29:11520:x1874700136426624:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 240us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853639.653136:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 174 00000100:00100000:3.0:1787853639.657773:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853639.658004:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136426880 00000100:00100000:0.0:1787853639.658017:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136426880 00000100:00100000:0.0:1787853639.658131:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 175 00000100:00100000:0.0:1787853639.658143:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+29:11520:x1874700136426880:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853639.658169:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853639.658173:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787853639.658206:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb05541f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2200 expref: 29 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.658227:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:0.0:1787853639.658232:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853639.658264:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055473 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2215 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787853639.659525:0:5826:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787853639.659980:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb05547a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.659999:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb05547a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.660013:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb05547a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.660156:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055473 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2215 expref: 31 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.660175:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb05547a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2215 expref: 30 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.660184:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff992761dc9900) 00010000:00010000:0.0:1787853639.660187:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853639.660190:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a8a00, rc 0) 00000100:00100000:0.0:1787853639.660278:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+30:11520:x1874700136426880:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 2136us (2515us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787853639.660288:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 175 00000100:00100000:2.0:1787853639.663720:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853639.663854:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136427136 00000100:00100000:1.0:1787853639.663866:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136427136 00000100:00100000:1.0:1787853639.663931:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 176 00000100:00100000:1.0:1787853639.663943:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761f48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+30:11520:x1874700136427136:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787853639.664017:0:7618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853639.664051:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb05547a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2215 expref: 30 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.664089:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff992761dc9900) 00010000:00010000:1.0:1787853639.664102:0:7618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853639.664132:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb055488 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.664147:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb055488 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.664174:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb055488 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.664276:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05548f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x294c593a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.664285:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05548f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x294c593a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.664293:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05548f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x294c593a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.664623:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb055488 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.664632:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb055488 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.664639:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb055488 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.664646:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853639.664651:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb055488 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.664659:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb055488 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.664725:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:1.0:1787853639.664728:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853639.664733:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb055488 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.664747:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb055488 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.664758:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05548f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x294c593a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.664765:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05548f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x294c593a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.664771:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05548f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x294c593a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.664776:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853639.664780:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05548f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x294c593a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.664786:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05548f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x294c593a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.664794:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x294c593a (ffff9927433f1000) 00010000:00010000:1.0:1787853639.664797:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853639.664799:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05548f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x294c593a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.664805:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05548f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x294c593a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853639.664903:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761f48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+29:11520:x1874700136427136:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 959us (1194us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787853639.664912:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 176 00000100:00100000:2.0:1787853639.667171:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853639.667312:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136427264 00000100:00100000:3.0:1787853639.667324:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136427264 00000100:00100000:3.0:1787853639.667404:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 177 00000100:00100000:3.0:1787853639.667417:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761f492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+29:11520:x1874700136427264:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787853639.667443:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853639.667471:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb055496 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd221c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.667519:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb05549d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.667535:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb05549d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.667548:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb05549d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.667716:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb055496 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd221c expref: 31 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.667740:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb05549d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd221c expref: 30 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.667750:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff992742cdd900) 00010000:00010000:3.0:1787853639.667760:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787853639.667765:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064c200, rc 0) 00000100:00100000:3.0:1787853639.667835:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761f492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+30:11520:x1874700136427264:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 420us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853639.667842:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 177 00000100:00100000:3.0:1787853639.671014:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853639.671331:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136427520 00000100:00100000:1.0:1787853639.671343:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136427520 00000100:00100000:1.0:1787853639.671421:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 178 00000100:00100000:1.0:1787853639.671432:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+30:11520:x1874700136427520:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787853639.671542:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0554a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.671562:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0554a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.671575:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0554a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787853639.671969:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1787853639.671981:0:7618:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 333969307173ns, next at 334969304611ns, rc = 0 00000004:00010000:1.0:1787853639.672447:0:7618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a2ef931 reply state 00000000c8e9eb54 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0554a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853639.672459:0:7618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787853639.672605:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+32:11520:x1874700136427520:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 1174us (1604us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1787853639.672614:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 178 00000100:00100000:2.0:1787853639.675773:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00010000:00010000:0.0:1787853639.675837:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0554a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.675851:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0554a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.675883:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0554a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.675890:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853639.675896:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0554a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.675905:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0554a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.675927:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff992742cdd900) 00010000:00010000:0.0:1787853639.675930:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787853639.675937:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0554a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.675945:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0554a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853639.676628:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136427648 00000100:00100000:3.0:1787853639.676642:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136427648 00000100:00100000:3.0:1787853639.676894:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 179 00000100:00100000:3.0:1787853639.676906:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761f48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+31:11520:x1874700136427648:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787853639.676936:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853639.676959:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb0554ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2223 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.677034:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb0554ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2223 expref: 32 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.677050:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb0554ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2223 expref: 32 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.677147:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff992742cdd900) 00010000:00010000:3.0:1787853639.677151:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787853639.677154:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064d400, rc 0) 00000100:00100000:3.0:1787853639.677271:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761f48b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+32:11520:x1874700136427648:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 367us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853639.677279:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 179 00000100:00100000:3.0:1787853639.680457:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853639.680608:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136427776 00000100:00100000:2.0:1787853639.680620:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136427776 00000100:00100000:3.0:1787853639.681129:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:3.0:1787853639.681142:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642106580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2364:x1874700136427776:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787853639.681563:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642106580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2364:x1874700136427776:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 423us (1119us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787853639.681574:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00080000:0.0:1787853639.683603:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853639.684515:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853639.684592:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136428032 00000100:00100000:0.0:1787853639.684605:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136428032 00000100:00100000:0.0:1787853639.684702:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:0.0:1787853639.684714:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daf1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+32:11520:x1874700136428032:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787853639.685717:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daf1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+33:11520:x1874700136428032:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 1000us (1205us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1787853639.685730:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:3.0:1787853639.688231:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853639.688574:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136428288 00000100:00100000:1.0:1787853639.688586:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136428288 00000100:00100000:1.0:1787853639.688900:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 180 00000100:00100000:1.0:1787853639.688914:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+33:11520:x1874700136428288:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787853639.689124:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+33:11520:x1874700136428288:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 212us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853639.689155:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 180 00000100:00100000:3.0:1787853639.693302:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853639.693981:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136428416 00000100:00100000:1.0:1787853639.693996:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136428416 00000100:00100000:1.0:1787853639.694375:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 181 00000100:00100000:1.0:1787853639.694389:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+33:11520:x1874700136428416:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853639.694415:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853639.694441:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb0554b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd222a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.694534:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0554b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.694553:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0554b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.694567:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0554b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853639.694614:0:5826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853639.694639:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0554b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.694707:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb0554b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd222a expref: 35 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.694730:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0554b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd222a expref: 34 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.694740:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff992742cdd900) 00010000:00010000:1.0:1787853639.694760:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787853639.694765:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196400, rc 0) 00000100:00100000:1.0:1787853639.695299:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+34:11520:x1874700136428416:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 910us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853639.695310:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 181 00000100:00100000:3.0:1787853639.698736:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853639.699210:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136428544 00000100:00100000:0.0:1787853639.699223:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136428544 00000100:00100000:0.0:1787853639.699279:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:0.0:1787853639.699289:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de1a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2364:x1874700136428544:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853639.699313:0:11669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853639.699348:0:11669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d74131f/0xcf1365f7cb0554c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2231 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853639.699382:0:11669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a907b47, blocks: 0x1 00010000:00010000:0.0:1787853639.699407:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=333s v=(0 0) 00010000:00010000:0.0:1787853639.699413:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853639.699424:0:11669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d74131f/0xcf1365f7cb0554c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2231 expref: 8 pid: 11669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.699445:0:11669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006d74131f/0xcf1365f7cb0554c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2231 expref: 8 pid: 11669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.699460:0:11669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a9400, rc 0) 00000100:00100000:0.0:1787853639.699528:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de1a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2364:x1874700136428544:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 240us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853639.699536:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:3.0:1787853639.713243:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853639.715011:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136428800 00000100:00100000:2.0:1787853639.715030:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136428800 00000100:00100000:2.0:1787853639.715915:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 182 00000100:00100000:2.0:1787853639.715933:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+34:11520:x1874700136428800:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787853639.716090:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+34:11520:x1874700136428800:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 164us (2861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853639.716098:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 182 00000100:00100000:2.0:1787853639.725575:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853639.725711:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136428928 00000100:00100000:0.0:1787853639.725724:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136428928 00000100:00100000:0.0:1787853639.725782:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:0.0:1787853639.725793:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761f4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:11520:x1874700136428928:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853639.725816:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853639.725840:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066abfd9b/0xcf1365f7cb0554c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2238 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.725877:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006d74131f/0xcf1365f7cb0554c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2231 expref: 9 pid: 11669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.725900:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787853639.725905:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853639.725912:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066abfd9b/0xcf1365f7cb0554c7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2238 expref: 9 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.725949:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006d74131f/0xcf1365f7cb0554c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2231 expref: 9 pid: 11669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.725966:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006d74131f/0xcf1365f7cb0554c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2231 expref: 9 pid: 11669 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853639.725982:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992775483c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6672:1874700152151296:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787853639.726099:0:6672:0:(client.c:2715:ptlrpc_set_wait()) set ffff992745a90cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853639.728396:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992775483c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6672:1874700152151296:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787853639.728441:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000066abfd9b/0xcf1365f7cb0554c7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2238 expref: 9 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.728468:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a9200, rc 0) 00000100:00100000:0.0:1787853639.728540:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761f4a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:11520:x1874700136428928:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 2747us (2974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853639.728551:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:0.0:1787853639.743953:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853639.744123:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136429056 00000100:00100000:1.0:1787853639.744135:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136429056 00010000:00010000:1.0:1787853639.744190:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006d74131f/0xcf1365f7cb0554c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2231 expref: 9 pid: 11669 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853639.744243:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:1.0:1787853639.744256:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775483c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:2364:x1874700136429056:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853639.744278:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853639.744307:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006d74131f/0xcf1365f7cb0554c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2231 expref: 9 pid: 11669 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.744339:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006d74131f/0xcf1365f7cb0554c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2231 expref: 9 pid: 11669 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.744382:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d74131f/0xcf1365f7cb0554c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2231 expref: 9 pid: 11669 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.744411:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853639.744416:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853639.744426:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000066abfd9b/0xcf1365f7cb0554c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2238 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.744461:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066abfd9b/0xcf1365f7cb0554c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2238 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.744508:0:5811:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000066abfd9b/0xcf1365f7cb0554c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2238 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853639.744526:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276daf1a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5811:1874700152151424:192.168.206.10@tcp:105: 00000100:00100000:1.0:1787853639.744641:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927412549c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853639.758461:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853639.758567:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276daf1a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5811:1874700152151424:192.168.206.10@tcp:105: 00010000:00010000:1.0:1787853639.758600:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853639.758721:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775483c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2364:x1874700136429056:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 14467us (14783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853639.758735:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:0.0:1787853639.758963:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136429184 00000100:00100000:0.0:1787853639.758973:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136429184 00002000:00100000:0.0:1787853639.759049:0:6676:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff99276de1b840 x1874700136429184/t0(0) o4->0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp:60/0 lens 504/0 e 0 to 0 dl 1787853650 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787853639.759060:0:6676:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99276de1b840 with x1874700136429184 ext(0->8) 00002000:00010000:0.0:1787853639.759081:0:6676:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99276de1b840 00000100:00100000:0.0:1787853639.759115:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:0.0:1787853639.759126:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de1b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2364:x1874700136429184:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787853639.759908:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de1b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+10:2364:x1874700136429184:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 Request processed in 780us (1458us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787853639.759918:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00002000:00100000:0.0:1787853639.759926:0:6676:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff99276de1b840 x1874700136429184/t4294967314(0) o4->0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp:60/0 lens 504/448 e 0 to 0 dl 1787853650 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787853639.759934:0:6676:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99276de1b840 with x1874700136429184 ext(0->8) 00002000:00010000:0.0:1787853639.759939:0:6676:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99276de1b840 00000100:00100000:0.0:1787853639.766106:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853639.766161:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136429312 00000100:00100000:0.0:1787853639.766173:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136429312 00000100:00100000:0.0:1787853639.766241:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 183 00000100:00100000:0.0:1787853639.766253:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+34:11520:x1874700136429312:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787853639.824621:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+34:11520:x1874700136429312:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 Request processed in 58355us (58512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853639.824638:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 183 00000001:00080000:3.0:1787853639.824999:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:3.0:1787853639.825023:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1787853639.825028:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1787853639.825059:0:5846:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1787853639.825151:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:3.0:1787853639.825182:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1787853639.825199:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787853639.826779:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787853639.826820:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276daf1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152151552:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787853639.826981:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853639.827060:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152151552 00000100:00100000:2.0:1787853639.827163:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152151552 00000100:00100000:2.0:1787853639.827229:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787853639.827241:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daf21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152151552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787853639.827455:0:11669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787853639.827459:0:11669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787853639 00002000:00010000:2.0:1787853639.827461:0:11669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787853639.827463:0:11669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787853639 -> 1787853639 00002000:00010000:2.0:1787853639.827465:0:11669:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787853639.827521:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daf21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3298:x1874700152151552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 282us (540us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787853639.827530:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1787853639.827562:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99276daf1a40/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787853639.827570:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276daf1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152151552:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787853639.830334:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853639.830435:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136429440 00000100:00100000:3.0:1787853639.830449:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136429440 00000100:00100000:3.0:1787853639.830579:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 55 00000100:00100000:3.0:1787853639.830591:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761f4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+10:2365:x1874700136429440:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787853639.869411:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:2.0:1787853639.869444:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1787853639.869709:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761f4a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2365:x1874700136429440:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 Request processed in 39112us (39380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853639.869734:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 55 00000100:00100000:3.0:1787853639.873851:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853639.873944:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136429696 00000100:00100000:2.0:1787853639.873957:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136429696 00000100:00100000:2.0:1787853639.874082:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 184 00000100:00100000:2.0:1787853639.874095:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+18:11520:x1874700136429696:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787853639.874167:0:7618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853639.874204:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0554b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd222a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.874223:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff992742cdd900) 00010000:00010000:2.0:1787853639.874229:0:7618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853639.874269:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0554ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.874298:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0554ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853639.874310:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0554ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787853639.874704:0:7618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec651764 reply state 000000008f9f2902 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0554ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853639.874715:0:7618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787853639.874850:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:11520:x1874700136429696:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 756us (1007us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1787853639.874859:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 184 00010000:00010000:3.0:1787853639.877809:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0554ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.877832:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0554ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.877840:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0554ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.877847:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853639.877853:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0554ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.877861:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0554ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.877883:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff992742cdd900) 00010000:00010000:3.0:1787853639.877887:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853639.877892:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0554ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.877899:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0554ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853639.879944:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853639.879992:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136429824 00000100:00100000:1.0:1787853639.880004:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136429824 00000100:00100000:1.0:1787853639.880080:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 56 00000100:00100000:1.0:1787853639.880093:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2365:x1874700136429824:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787853639.880412:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787853639.880417:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787853639 -> 1787853638 00002000:00010000:1.0:1787853639.880420:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787853637 00002000:00010000:1.0:1787853639.880422:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787853639 -> 1787853638 00002000:00010000:1.0:1787853639.880425:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787853639.880504:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2365:x1874700136429824:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 413us (574us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787853639.880514:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 56 00000100:00100000:2.0:1787853639.883214:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853639.883290:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136430080 00000100:00100000:0.0:1787853639.883303:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136430080 00000100:00100000:0.0:1787853639.883590:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 185 00000100:00100000:0.0:1787853639.883616:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761f4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+18:11520:x1874700136430080:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787853639.883739:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0554d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.883769:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb05549d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd221c expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.883781:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0554d5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.883825:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb05549d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd221c expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.883842:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb05549d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd221c expref: 18 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853639.883860:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927500d0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5826:1874700152151680:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787853639.883972:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff992745a90900 going to sleep for 11 seconds 00000100:00100000:3.0:1787853639.890013:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927500d0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5826:1874700152151680:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787853639.890058:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0554d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853639.890144:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853639.893060:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136430208 00000100:00100000:3.0:1787853639.893501:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136430208 00010000:00010000:3.0:1787853639.893563:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb05549d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd221c expref: 19 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853639.893625:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 70 00000100:00100000:3.0:1787853639.893637:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:2364:x1874700136430208:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853639.893656:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853639.893756:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb05549d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd221c expref: 19 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.893773:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb05549d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd221c expref: 19 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.893802:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb05549d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd221c expref: 19 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.893820:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff992742cdd900) 00010000:00010000:3.0:1787853639.893827:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0554d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.893838:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0554d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.893848:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0554d5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.893885:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853639.893979:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+18:2364:x1874700136430208:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 344us (3835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853639.893988:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 70 00010000:00010000:3.0:1787853639.894026:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0554d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.894035:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0554d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787853639.897818:0:12490:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787853639.897829:0:12490:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787853639.897887:0:12490:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1787853639.897893:0:12490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787853639.899335:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0554d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.899351:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0554d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.899360:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0554d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.899366:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853639.899372:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0554d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.899440:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0554d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.899461:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff992742cdd900) 00010000:00010000:3.0:1787853639.899464:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787853639.899469:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0554d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.899477:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0554d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853639.900965:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761f4b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+17:11520:x1874700136430080:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 Request processed in 17344us (17752us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787853639.900981:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 185 00000100:00100000:2.0:1787853639.903201:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853639.905922:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136430336 00000100:00100000:3.0:1787853639.905944:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136430336 00000100:00100000:3.0:1787853639.908275:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:3.0:1787853639.908290:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761f4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2362:x1874700136430336:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787853639.908347:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006edf1f79/0xcf1365f7cb0554dc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.908464:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000066abfd9b/0xcf1365f7cb0554c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2238 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.908531:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853639.908536:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853639.908541:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006edf1f79/0xcf1365f7cb0554dc lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.908584:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000066abfd9b/0xcf1365f7cb0554c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2238 expref: 8 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.908599:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000066abfd9b/0xcf1365f7cb0554c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2238 expref: 8 pid: 6672 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853639.908615:0:6672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276de1ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6672:1874700152151808:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787853639.909327:0:6672:0:(client.c:2715:ptlrpc_set_wait()) set ffff992758543d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787853639.914018:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853639.914115:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136430464 00000100:00100000:0.0:1787853639.914126:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136430464 00010000:00010000:0.0:1787853639.914178:0:8433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000066abfd9b/0xcf1365f7cb0554c7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2238 expref: 9 pid: 6672 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853639.914222:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00100000:0.0:1787853639.914234:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761f49680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:2364:x1874700136430464:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853639.914253:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853639.914301:0:8433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000066abfd9b/0xcf1365f7cb0554c7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2238 expref: 9 pid: 6672 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.914318:0:8433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000066abfd9b/0xcf1365f7cb0554c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2238 expref: 9 pid: 6672 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.914352:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787853639.914357:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787853639.914364:0:8433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006edf1f79/0xcf1365f7cb0554dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.914377:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006edf1f79/0xcf1365f7cb0554dc lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.914412:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853639.914511:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761f49680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:2364:x1874700136430464:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 279us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853639.914520:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 71 00010000:00010000:3.0:1787853639.915236:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066abfd9b/0xcf1365f7cb0554c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2238 expref: 8 pid: 6672 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853639.915274:0:6672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276de1ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6672:1874700152151808:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787853639.915306:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006edf1f79/0xcf1365f7cb0554dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.915319:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006edf1f79/0xcf1365f7cb0554dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.915327:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006edf1f79/0xcf1365f7cb0554dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.915362:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006edf1f79/0xcf1365f7cb0554dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.915371:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006edf1f79/0xcf1365f7cb0554dc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.915390:0:6672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006edf1f79/0xcf1365f7cb0554dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.915399:0:6672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064c200 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:3.0:1787853639.915404:0:6672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006edf1f79/0xcf1365f7cb0554dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.915414:0:6672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006edf1f79/0xcf1365f7cb0554dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.915437:0:6672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006edf1f79/0xcf1365f7cb0554dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.915446:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006edf1f79/0xcf1365f7cb0554dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853639.915657:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761f4b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2362:x1874700136430336:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 Request processed in 7368us (12469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853639.915667:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:3.0:1787853639.925363:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853639.925788:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136430720 00000100:00100000:0.0:1787853639.925802:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136430720 00000100:00100000:0.0:1787853639.925881:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 186 00000100:00100000:0.0:1787853639.925894:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+17:11520:x1874700136430720:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787853639.926002:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0554e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.926024:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0554e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.926058:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0554e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.926330:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb0554ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.926343:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb0554ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2223 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.926353:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb0554ea lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.929194:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb0554ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2223 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.929225:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb0554ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2223 expref: 18 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853639.929246:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927500d0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5824:1874700152151936:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787853639.929450:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff992745a90900 going to sleep for 11 seconds 00000100:00100000:3.0:1787853639.932259:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927500d0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5824:1874700152151936:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787853639.932259:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00010000:00010000:3.0:1787853639.932294:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb0554ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853639.932299:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136430848 00000100:00100000:0.0:1787853639.932306:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136430848 00010000:00010000:0.0:1787853639.932352:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb0554ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2223 expref: 19 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853639.932621:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 72 00000100:00100000:0.0:1787853639.932634:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:2364:x1874700136430848:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853639.932660:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853639.932669:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb0554ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2223 expref: 19 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.932699:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb0554ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2223 expref: 19 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.932726:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d400/0xcf1365f7cb0554ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2223 expref: 19 pid: 5825 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.932741:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff992742cdd900) 00010000:00010000:0.0:1787853639.932746:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb0554ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.932756:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb0554ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.932764:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb0554ea lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.932786:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853639.932839:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+18:2364:x1874700136430848:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 208us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853639.932847:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 72 00010000:00010000:1.0:1787853639.934769:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb0554ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.934788:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb0554ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787853639.935022:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1787853639.935249:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1787853639.935294:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1787853639.936157:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99264227d680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5824:1874700152152064:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787853639.936237:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853639.936281:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927661690c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853639.936523:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152152064 00000100:00100000:0.0:1787853639.936533:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152152064 00000100:00100000:0.0:1787853639.936588:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787853639.936599:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1874700152152064:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787853639.936722:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1874700152152064:12345-0@lo:1000:mdt00_000.0 Request processed in 124us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853639.936744:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787853639.936955:0:5824:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1787853639.936961:0:5824:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99276daf1a40, transno 4294967315 00000100:00100000:1.0:1787853639.936985:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99264227d680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5824:1874700152152064:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787853639.938146:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1787853639.938243:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99264227d680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5824:1874700152152192:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787853639.938307:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853639.938386:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff992748fb2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787853639.938922:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152152192 00000100:00100000:0.0:1787853639.938931:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152152192 00000100:00100000:1.0:1787853639.939115:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787853639.939124:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1874700152152192:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787853639.939646:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5824:x1874700152152192:12345-0@lo:1000:mdt00_000.0 Request processed in 520us (1335us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787853639.939657:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787853639.939801:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99264227d680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5824:1874700152152192:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787853639.939847:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb0554ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.939858:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb0554ea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.939867:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb0554ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.939873:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853639.939879:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb0554ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.939888:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb0554ea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.939908:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff992742cdd900) 00010000:00010000:1.0:1787853639.939911:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787853639.939916:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb0554ea lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.939932:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb0554ea lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.939968:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055426 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.939975:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055426 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.939980:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055426 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.939986:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a9800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853639.939989:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055426 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.939995:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055426 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.940004:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992761dc9d00) 00010000:00010000:1.0:1787853639.940007:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787853639.940010:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055426 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.940015:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055426 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.940037:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0554f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.940053:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055442 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2207 expref: 21 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.940132:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0554f1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.940172:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055442 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2207 expref: 21 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.940191:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055442 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2207 expref: 21 pid: 5826 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853639.940207:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99264227c780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5824:1874700152152320:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787853639.940352:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d5c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853639.942664:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99264227c780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5824:1874700152152320:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787853639.942721:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0554f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853639.943496:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853639.944123:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136430976 00000100:00100000:3.0:1787853639.944151:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136430976 00010000:00010000:3.0:1787853639.944202:0:8433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055442 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2207 expref: 22 pid: 5826 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853639.944243:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 73 00000100:00100000:3.0:1787853639.944252:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:2364:x1874700136430976:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853639.944270:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853639.944277:0:8433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055442 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2207 expref: 22 pid: 5826 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.944309:0:8433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055442 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2207 expref: 22 pid: 5826 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.944336:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055442 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2207 expref: 22 pid: 5826 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.944353:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992761dc9d00) 00010000:00010000:3.0:1787853639.944359:0:8433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0554f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.944369:0:8433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0554f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.944378:0:8433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0554f1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853639.944560:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853639.944624:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+21:2364:x1874700136430976:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 372us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853639.944631:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 73 00010000:00010000:0.0:1787853639.945302:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0554f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.945313:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0554f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.945328:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0554f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.945334:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0554f1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.945342:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0554f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.945348:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853639.945353:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0554f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.945361:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0554f1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.945376:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992761dc9d00) 00010000:00010000:0.0:1787853639.945379:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853639.945383:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0554f1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.945390:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0554f1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.945538:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0554e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.945545:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0554e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.945551:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0554e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.945556:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853639.945559:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0554e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.945565:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0554e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.945573:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992761dc9d00) 00010000:00010000:0.0:1787853639.945575:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787853639.945578:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0554e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.945584:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0554e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853639.946031:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+20:11520:x1874700136430720:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 20136us (20678us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1787853639.946043:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 186 00000020:00080000:1.0:1787853639.946048:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787853639.946892:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787853639.946900:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787853639.948358:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787853639.948387:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787853639.949329:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853639.949538:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136431232 00000100:00100000:1.0:1787853639.949551:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136431232 00000100:00100000:1.0:1787853639.949622:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:1.0:1787853639.949632:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274f706850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+20:11520:x1874700136431232:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787853639.950786:0:5828:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787853639.950920:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1787853639.950990:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb0554f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.951010:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb0554f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.951024:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb0554f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.951033:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb0554f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.951040:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb0554f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.951047:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb0554f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853639.951115:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787853639.951240:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274f706850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:11520:x1874700136431232:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 1605us (1914us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1787853639.951252:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 50 00000020:00080000:1.0:1787853639.951259:0:5828:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787853639.951355:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853639.951369:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb0554f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.951528:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196200 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853639.951534:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb0554f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.951544:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb0554f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.951622:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9927433f1000) 00010000:00010000:0.0:1787853639.951626:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787853639.951632:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb0554f8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.951639:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb0554f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853639.951659:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853639.951661:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853639.951663:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853640.583035:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787853640.966493:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787853640.966502:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787853640.966716:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787853640.966723:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787853641.610661:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787853641.796807:0:12541:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787853641.796817:0:12541:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787853641.796862:0:12541:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787853641.796869:0:12541:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787853641.913442:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853641.919390:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136431488 00000100:00100000:1.0:1787853641.919409:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136431488 00000100:00100000:1.0:1787853641.919559:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 187 00000100:00100000:1.0:1787853641.919571:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:11538:x1874700136431488:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787853641.919616:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853641.919642:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb0554ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd223f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853641.920040:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196a00/0xcf1365f7cb055506 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853641.920072:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196a00/0xcf1365f7cb055506 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853641.920088:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196a00/0xcf1365f7cb055506 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853641.920102:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787853641.920326:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb0554ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd223f expref: 25 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853641.920346:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196a00/0xcf1365f7cb055506 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd223f expref: 24 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853641.920356:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:1.0:1787853641.920360:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787853641.920364:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196a00, rc 0) 00000100:00100000:1.0:1787853641.920464:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+24:11538:x1874700136431488:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 895us (7035us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1787853641.920473:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 187 00000100:00080000:0.0:1787853641.926611:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853641.927159:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853641.927251:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136431616 00000100:00100000:0.0:1787853641.927267:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136431616 00000100:00100000:0.0:1787853641.927363:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 188 00000100:00100000:0.0:1787853641.927378:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761f49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+24:11538:x1874700136431616:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:0.0:1787853641.927491:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055514 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.927513:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055514 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.927542:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055514 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.927563:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05551b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.927570:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05551b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.927577:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05551b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928249:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055522 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928260:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928268:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787853641.928380:0:7618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928398:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055514 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928406:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055514 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928415:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055514 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928433:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853641.928438:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055514 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928448:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055514 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928463:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:0.0:1787853641.928467:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853641.928473:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055514 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928480:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055514 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928496:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05551b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928503:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05551b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928509:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05551b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928515:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853641.928518:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05551b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928524:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05551b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928543:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff992761dc9a00) 00010000:00010000:0.0:1787853641.928545:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853641.928548:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05551b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928555:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05551b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928572:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928578:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055522 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928584:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055522 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928589:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a9600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853641.928592:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055522 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928598:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055522 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928606:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992761dc9d00) 00010000:00010000:0.0:1787853641.928608:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853641.928611:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055522 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853641.928617:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055522 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853641.929987:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761f49e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+24:11538:x1874700136431616:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 2602us (2826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853641.930003:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 188 00000100:00100000:1.0:1787853641.971151:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853641.971412:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136431872 00000100:00100000:2.0:1787853641.971429:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136431872 00000100:00100000:2.0:1787853641.971515:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 189 00000100:00100000:2.0:1787853641.971529:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+24:11541:x1874700136431872:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787853641.971558:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853641.971587:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055529 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2246 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.971849:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055530 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.972183:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055530 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.972199:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055530 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.972221:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055537 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.972229:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.972236:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.975191:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05553e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.975220:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05553e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.975237:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05553e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853641.975255:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787853641.976250:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055530 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.976266:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055530 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.976275:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055530 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.976437:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853641.976443:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055530 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.976452:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055530 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.976471:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:2.0:1787853641.976475:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853641.976480:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055530 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.976487:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70400/0xcf1365f7cb055530 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.976501:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.976508:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055537 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.976514:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055537 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.976519:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853641.976522:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055537 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.976529:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055537 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.976548:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff992743be3e00) 00010000:00010000:2.0:1787853641.976550:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853641.976554:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055537 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.976561:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055537 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.976625:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055529 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2246 expref: 27 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.976642:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05553e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2246 expref: 26 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853641.976650:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992743be3800) 00010000:00010000:2.0:1787853641.976653:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853641.976656:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71000, rc 0) 00000100:00100000:2.0:1787853641.977527:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+26:11541:x1874700136431872:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 5994us (6383us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1787853641.977538:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 189 00000100:00100000:2.0:1787853641.993975:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853641.998073:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136432000 00000100:00100000:3.0:1787853641.998088:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136432000 00000100:00100000:0.0:1787853642.002630:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 190 00000100:00100000:0.0:1787853642.002648:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761f48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+26:11541:x1874700136432000:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:0.0:1787853642.004467:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb05554c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.004493:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb05554c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.004508:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb05554c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.004543:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb05554c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.004551:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb05554c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.004559:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb05554c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.004565:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a9600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853642.004570:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb05554c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.004578:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb05554c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.004606:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992743be3800) 00010000:00010000:0.0:1787853642.004609:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787853642.004615:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb05554c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.004622:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb05554c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853642.008950:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761f48f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+26:11541:x1874700136432000:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 6287us (14971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853642.008969:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 190 00000100:00100000:0.0:1787853642.021632:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853642.027100:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136432256 00000100:00100000:3.0:1787853642.027119:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136432256 00000100:00100000:3.0:1787853642.027217:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:3.0:1787853642.027228:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dade940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+26:11541:x1874700136432256:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787853642.027701:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dade940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+27:11541:x1874700136432256:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 473us (6081us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787853642.027710:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:0.0:1787853642.075643:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853642.075698:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136432512 00000100:00100000:0.0:1787853642.075709:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136432512 00000100:00100000:0.0:1787853642.075777:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 191 00000100:00100000:0.0:1787853642.075789:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+27:11067:x1874700136432512:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787853642.075821:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853642.075846:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055553 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd224d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.075975:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05555a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.077966:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05553e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2246 expref: 28 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.078540:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05555a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.078606:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05553e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2246 expref: 28 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.078623:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05553e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2246 expref: 28 pid: 5825 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853642.078643:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dadc3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5826:1874700152152448:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787853642.078793:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276ad4c780 going to sleep for 11 seconds 00000100:00100000:0.0:1787853642.084255:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dadc3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5826:1874700152152448:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787853642.084426:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05555a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853642.085269:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853642.085767:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136432640 00000100:00100000:2.0:1787853642.085777:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136432640 00010000:00010000:2.0:1787853642.085825:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05553e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2246 expref: 29 pid: 5825 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853642.085870:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 74 00000100:00100000:2.0:1787853642.085889:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dada580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+29:2364:x1874700136432640:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853642.085908:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853642.085916:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05553e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2246 expref: 29 pid: 5825 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853642.085931:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05553e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2246 expref: 29 pid: 5825 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853642.085958:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71000/0xcf1365f7cb05553e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2246 expref: 29 pid: 5825 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853642.085973:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992743be3800) 00010000:00010000:2.0:1787853642.085979:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05555a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853642.086001:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05555a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853642.086010:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05555a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853642.086036:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853642.086115:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dada580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+28:2364:x1874700136432640:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 227us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853642.086124:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 74 00010000:00010000:0.0:1787853642.087176:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05555a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.087189:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05555a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853642.087213:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787853642.087580:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055553 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd224d expref: 29 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.087603:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05555a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd224d expref: 28 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.087613:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992743be3800) 00010000:00010000:0.0:1787853642.087616:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787853642.087630:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a8400, rc 0) 00000100:00100000:0.0:1787853642.088788:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+28:11067:x1874700136432512:12345-192.168.206.10@tcp:101:bash.0 Request processed in 12991us (13147us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787853642.088800:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 191 00000100:00100000:1.0:1787853642.095304:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853642.095507:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136432896 00000100:00100000:0.0:1787853642.095521:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136432896 00000100:00100000:0.0:1787853642.095596:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 192 00000100:00100000:0.0:1787853642.095608:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+28:11067:x1874700136432896:12345-192.168.206.10@tcp:36:bash.0 00010000:00010000:0.0:1787853642.095973:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055568 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.096068:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055568 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.096085:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055568 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787853642.096150:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1787853642.096181:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fd630a2 reply state 00000000e3c55ad2 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055568 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853642.096193:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787853642.096246:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1787853642.096883:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+32:11067:x1874700136432896:12345-192.168.206.10@tcp:36:bash.0 Request processed in 1272us (1601us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1787853642.096895:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 192 00000020:00080000:0.0:1787853642.096901:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787853642.102082:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055568 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.102106:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055568 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.102132:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055568 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.102139:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853642.102146:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055568 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.102155:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055568 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.102177:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992743be3800) 00010000:00010000:0.0:1787853642.102181:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853642.102187:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055568 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.102194:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb055568 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853642.104261:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853642.104780:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136433024 00000100:00100000:0.0:1787853642.104791:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136433024 00000100:00100000:0.0:1787853642.104853:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 193 00000100:00100000:0.0:1787853642.104865:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+31:11067:x1874700136433024:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787853642.105479:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853642.105507:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9c00/0xcf1365f7cb05556f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2254 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.105853:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9c00/0xcf1365f7cb05556f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2254 expref: 32 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.105893:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9c00/0xcf1365f7cb05556f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2254 expref: 32 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.105919:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992743be3800) 00010000:00010000:0.0:1787853642.105923:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787853642.106356:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a9c00, rc 0) 00000100:00100000:0.0:1787853642.106458:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+32:11067:x1874700136433024:12345-192.168.206.10@tcp:101:bash.0 Request processed in 1593us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853642.106467:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 193 00000100:00100000:2.0:1787853642.120097:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853642.120358:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136433152 00000100:00100000:3.0:1787853642.120370:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136433152 00000100:00100000:3.0:1787853642.120458:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 58 00000100:00100000:3.0:1787853642.120469:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dada1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:11067:x1874700136433152:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787853642.120492:0:11669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853642.120518:0:11669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009592ade5/0xcf1365f7cb055576 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd225b expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787853642.120552:0:11669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a907b46, atime: 0x6a907b45, ctime: 0x6a907b46, blocks: 0xb 00010000:00010000:3.0:1787853642.120580:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=336s v=(0 0) 00010000:00010000:3.0:1787853642.120585:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853642.120594:0:11669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009592ade5/0xcf1365f7cb055576 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd225b expref: 8 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.120614:0:11669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009592ade5/0xcf1365f7cb055576 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd225b expref: 8 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.120629:0:11669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064d000, rc 0) 00000100:00100000:3.0:1787853642.120732:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dada1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:11067:x1874700136433152:12345-192.168.206.10@tcp:101:bash.0 Request processed in 265us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853642.120752:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 58 00000100:00080000:1.0:1787853642.120891:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853642.125718:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853642.125889:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136433280 00000100:00100000:1.0:1787853642.125902:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136433280 00002000:00010000:1.0:1787853642.125954:0:6678:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1787853642.125960:0:6678:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99276dadcf00 with x1874700136433280 ext(0->18446744073709551615) 00002000:00010000:1.0:1787853642.125974:0:6678:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99276dadcf00. 00000100:00100000:1.0:1787853642.126114:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:1.0:1787853642.126126:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2363:x1874700136433280:12345-192.168.206.10@tcp:10:bash.0 00002000:00010000:1.0:1787853642.126451:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787853642.126455:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787853638 -> 1787853642 00002000:00010000:1.0:1787853642.126458:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787853637 -> 1787853637 00002000:00010000:1.0:1787853642.126460:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787853638 -> 1787853642 00002000:00010000:1.0:1787853642.126462:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787853642.126544:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:2363:x1874700136433280:12345-192.168.206.10@tcp:10:bash.0 Request processed in 419us (839us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787853642.126553:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00002000:00010000:1.0:1787853642.126557:0:6678:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1787853642.126559:0:6678:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99276dadcf00 with x1874700136433280 ext(0->18446744073709551615) 00002000:00010000:1.0:1787853642.126564:0:6678:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99276dadcf00. 00000001:00080000:1.0:1787853642.127113:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1787853642.127132:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1787853642.127137:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000100:00100000:3.0:1787853642.181477:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853642.181532:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853642.181575:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853642.181731:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136433408 00000100:00100000:2.0:1787853642.181743:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136433408 00000100:00100000:2.0:1787853642.181958:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 293 00000100:00100000:1.0:1787853642.182103:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136433664 00000100:00100000:1.0:1787853642.182108:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136433664 00000100:00100000:1.0:1787853642.182162:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 148 00000100:00100000:1.0:1787853642.182171:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2365:x1874700136433664:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787853642.182278:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2365:x1874700136433408:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853642.182278:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2365:x1874700136433664:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 108us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853642.182292:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 148 00000100:00080000:1.0:1787853642.182320:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853642.182381:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2365:x1874700136433408:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 397us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853642.182388:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 293 00000100:00100000:0.0:1787853642.182653:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136433536 00000100:00100000:0.0:1787853642.182754:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136433536 00000100:00080000:1.0:1787853642.182799:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853642.182936:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00100000:0.0:1787853642.182945:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136433536:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853642.183236:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136433536:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 290us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853642.183244:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00100000:3.0:1787853642.197409:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853642.197547:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136433792 00000100:00100000:0.0:1787853642.197560:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136433792 00000100:00100000:0.0:1787853642.197644:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 194 00000100:00100000:0.0:1787853642.197666:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+32:11555:x1874700136433792:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:0.0:1787853642.197808:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb05557d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.197829:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb05557d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.197859:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb05557d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.197946:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055584 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.197957:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055584 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.197968:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055584 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198480:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb05558b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198494:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb05558b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198503:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb05558b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787853642.198559:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb05558b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198575:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb05557d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198582:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb05557d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198590:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb05557d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198597:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853642.198602:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb05557d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198611:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb05557d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198626:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:1.0:1787853642.198636:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853642.198643:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb05557d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198649:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb05557d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198666:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055584 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198726:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055584 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198734:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055584 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198739:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a9600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853642.198742:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055584 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198748:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055584 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198756:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff992761dc9a00) 00010000:00010000:1.0:1787853642.198759:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853642.198761:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055584 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198766:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055584 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198783:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb05558b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198795:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb05558b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198801:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb05558b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198806:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853642.198809:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb05558b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198814:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb05558b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198822:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992743be3800) 00010000:00010000:1.0:1787853642.198825:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853642.198828:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb05558b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.198832:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb05558b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853642.198940:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+32:11555:x1874700136433792:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 1283us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853642.198951:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 194 00000100:00100000:2.0:1787853642.231234:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853642.231511:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136434048 00000100:00100000:1.0:1787853642.231525:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136434048 00000100:00100000:1.0:1787853642.231609:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 195 00000100:00100000:1.0:1787853642.231621:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+32:11558:x1874700136434048:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787853642.231650:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853642.231736:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055592 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2262 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.231969:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb055599 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.231988:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb055599 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.232002:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb055599 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.232018:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0555a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.232026:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0555a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.232033:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0555a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.232520:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0555a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.232531:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0555a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.232540:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0555a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853642.232551:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787853642.232666:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb055599 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.232719:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb055599 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.232726:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb055599 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.232733:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853642.232737:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb055599 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.232746:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb055599 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.232760:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:1.0:1787853642.232764:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853642.232912:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb055599 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.232920:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb055599 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.232937:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0555a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.232943:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0555a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.232949:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0555a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.232955:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853642.232964:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0555a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.232971:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0555a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.232979:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9927433f1b00) 00010000:00010000:1.0:1787853642.232982:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853642.232986:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0555a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.232992:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0555a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.233047:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055592 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2262 expref: 35 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.233074:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0555a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2262 expref: 34 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.233083:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992743be3800) 00010000:00010000:1.0:1787853642.233085:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787853642.233088:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196400, rc 0) 00000100:00100000:1.0:1787853642.233306:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+34:11558:x1874700136434048:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1686us (2086us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1787853642.233315:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 195 00000100:00100000:1.0:1787853642.238626:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853642.238843:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136434176 00000100:00100000:3.0:1787853642.238856:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136434176 00000100:00100000:3.0:1787853642.238929:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 196 00000100:00100000:3.0:1787853642.238940:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+34:11558:x1874700136434176:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:3.0:1787853642.239025:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0555b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.239045:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05555a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd224d expref: 34 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.239067:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0555b5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.239114:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05555a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd224d expref: 34 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.239131:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05555a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd224d expref: 34 pid: 5826 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853642.239169:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276de19a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5825:1874700152152576:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787853642.239356:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927463b3900 going to sleep for 11 seconds 00000100:00100000:3.0:1787853642.247429:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853642.247642:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276de19a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5825:1874700152152576:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787853642.247717:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0555b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853642.248011:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136434432 00000100:00100000:0.0:1787853642.248138:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136434432 00000100:00100000:0.0:1787853642.248373:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:0.0:1787853642.248403:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+35:5600:x1874700136434432:12345-192.168.206.10@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787853642.251152:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+36:5600:x1874700136434432:12345-192.168.206.10@tcp:35:ldlm_bl.0 Request processed in 2753us (3722us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1787853642.251203:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:2.0:1787853642.263014:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853642.263285:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136434560 00000100:00100000:1.0:1787853642.263299:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136434560 00010000:00010000:1.0:1787853642.263358:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05555a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd224d expref: 36 pid: 5826 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853642.263408:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 75 00000100:00100000:1.0:1787853642.263420:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274415dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+36:2365:x1874700136434560:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853642.263442:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853642.263905:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05555a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd224d expref: 36 pid: 5826 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.263925:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05555a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd224d expref: 36 pid: 5826 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.263955:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05555a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd224d expref: 36 pid: 5826 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.263978:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992743be3800) 00010000:00010000:1.0:1787853642.263985:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0555b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.263996:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0555b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.264006:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0555b5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.264059:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853642.264311:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0555b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853642.264322:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0555b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853642.264364:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0555b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853642.264372:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0555b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853642.264380:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0555b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853642.264387:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064c200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853642.264393:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0555b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853642.264402:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0555b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853642.264413:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992743be3800) 00010000:00010000:2.0:1787853642.264417:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787853642.264421:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0555b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853642.264427:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c200/0xcf1365f7cb0555b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853642.265791:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274415dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+35:2365:x1874700136434560:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 2348us (2768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853642.265808:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 75 00000100:00100000:2.0:1787853642.269718:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+34:11558:x1874700136434176:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 30760us (31087us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853642.269762:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 196 00000100:00100000:1.0:1787853642.278297:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853642.278575:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136434816 00000100:00100000:2.0:1787853642.278589:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136434816 00000100:00100000:2.0:1787853642.278661:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:2.0:1787853642.278961:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+34:11558:x1874700136434816:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787853642.279403:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+35:11558:x1874700136434816:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 730us (1121us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787853642.279414:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:1.0:1787853642.372960:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853642.373623:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136435072 00000100:00100000:0.0:1787853642.373637:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136435072 00000100:00100000:0.0:1787853642.374624:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 197 00000100:00100000:0.0:1787853642.374639:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+35:11569:x1874700136435072:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:0.0:1787853642.374696:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853642.374726:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb0555bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2269 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.374845:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0555c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.374895:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0555c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.374909:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0555c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.374928:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0555ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.374935:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0555ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.374942:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0555ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.375378:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb0555d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.375389:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb0555d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.375396:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb0555d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853642.375408:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787853642.375522:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0555c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.375531:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0555c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.375538:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0555c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.375551:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a9a00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853642.375556:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0555c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.375564:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0555c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.375579:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:0.0:1787853642.375582:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853642.375588:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0555c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.375594:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0555c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.375612:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0555ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.375618:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0555ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.375624:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0555ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.375629:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853642.375632:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0555ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.375639:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0555ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.375656:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff992761dc9c00) 00010000:00010000:0.0:1787853642.375659:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853642.375662:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0555ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.375668:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0555ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.375790:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb0555bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2269 expref: 38 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.375805:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb0555d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2269 expref: 37 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.375813:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992743be3800) 00010000:00010000:0.0:1787853642.375815:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853642.375818:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a8400, rc 0) 00000100:00100000:0.0:1787853642.375899:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+37:11569:x1874700136435072:12345-192.168.206.10@tcp:101:cat.0 Request processed in 1263us (2954us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1787853642.375909:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 197 00000100:00100000:2.0:1787853642.382046:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853642.382541:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136435328 00000100:00100000:0.0:1787853642.382555:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136435328 00000100:00100000:0.0:1787853642.382720:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 54 00000100:00100000:0.0:1787853642.382732:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+37:11569:x1874700136435328:12345-192.168.206.10@tcp:35:cat.0 00000100:00100000:0.0:1787853642.383110:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+38:11569:x1874700136435328:12345-192.168.206.10@tcp:35:cat.0 Request processed in 371us (1069us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1787853642.383119:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 54 00000100:00100000:2.0:1787853642.407240:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853642.407435:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136435584 00000100:00100000:0.0:1787853642.407447:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136435584 00000100:00100000:0.0:1787853642.407513:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 198 00000100:00100000:0.0:1787853642.407523:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dad9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+38:11570:x1874700136435584:12345-192.168.206.10@tcp:36:rm.0 00010000:00010000:0.0:1787853642.407597:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787853642.407630:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb0555d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2269 expref: 38 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.407656:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0555a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2262 expref: 37 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.407668:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9c00/0xcf1365f7cb05556f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2254 expref: 36 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.407717:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992743be3800) 00010000:00010000:0.0:1787853642.407730:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853642.407756:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb0555df lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.407783:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb0555df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.407794:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb0555df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.407810:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0555e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.407817:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0555e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.407846:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0555e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.408252:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0555ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.408262:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0555ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.408271:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0555ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787853642.409375:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1787853642.409389:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336706715583ns, next at 337706712333ns, rc = 0 00010000:00010000:1.0:1787853642.409466:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0555f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.409480:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0555f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.409491:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0555f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.409498:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0555f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.409505:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0555f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.409511:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0555f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.409539:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853642.409565:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0555ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.409570:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0555ed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.409588:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0555ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.409594:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a9a00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853642.409599:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0555ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.409607:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0555ed lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.409619:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992761dc9400) 00010000:00010000:1.0:1787853642.409628:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787853642.409632:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0555ed lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.409639:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9a00/0xcf1365f7cb0555ed lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.409664:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb0555df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.411025:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb0555df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.411047:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb0555df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.411111:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853642.411116:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb0555df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.411150:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb0555df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.411170:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:1.0:1787853642.411174:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853642.411179:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb0555df lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.411187:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8c00/0xcf1365f7cb0555df lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787853642.411209:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9412fca reply state 000000006a527cd5 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0555e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853642.411220:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787853642.411771:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853642.411781:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0555f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.411790:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196600 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:3.0:1787853642.411794:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0555f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.411803:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0555f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.411814:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff992761dc9400) 00010000:00010000:3.0:1787853642.411817:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787853642.411820:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0555f4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.411826:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0555f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.411847:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853642.411849:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853642.411851:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853642.412624:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dad9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+37:11570:x1874700136435584:12345-192.168.206.10@tcp:36:rm.0 Request processed in 5089us (5386us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1787853642.412638:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 198 00010000:00010000:3.0:1787853642.417626:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0555e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.417648:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0555e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.417657:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0555e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.417663:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853642.417668:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0555e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.422465:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0555e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.422495:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff992761dc9c00) 00010000:00010000:3.0:1787853642.422499:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853642.422507:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0555e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.422516:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8200/0xcf1365f7cb0555e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853642.488081:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853642.489242:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136435840 00000100:00100000:1.0:1787853642.489265:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136435840 00000100:00100000:1.0:1787853642.489366:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 199 00000100:00100000:1.0:1787853642.489379:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+36:11576:x1874700136435840:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:1.0:1787853642.489415:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853642.489442:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb0555fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2270 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.490881:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055602 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.490930:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055602 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.490944:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055602 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.490962:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055609 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.490970:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055609 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.490976:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055609 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787853642.491653:0:7618:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1787853642.494487:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb055610 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.494516:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb055610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.494531:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb055610 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.494575:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055602 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.494583:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055602 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.494591:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055602 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.494616:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853642.494621:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055602 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.494629:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055602 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.494644:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:1.0:1787853642.494647:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853642.494653:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055602 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.494660:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055602 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787853642.494701:0:7618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061989a3f reply state 0000000023ee3a77 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055609 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853642.494711:0:7618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787853642.494756:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb0555fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2270 expref: 39 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.494778:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb055610 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2270 expref: 38 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.494786:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9927433f1900) 00010000:00010000:1.0:1787853642.494788:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787853642.494790:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766197400, rc 0) 00000100:00100000:1.0:1787853642.494893:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+39:11576:x1874700136435840:12345-192.168.206.10@tcp:101:bash.0 Request processed in 5516us (6826us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1787853642.494910:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 199 00000100:00100000:1.0:1787853642.502962:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00010000:00010000:0.0:1787853642.503623:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055609 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.503640:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055609 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.503649:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055609 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.503656:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853642.503662:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055609 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.503690:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055609 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.503713:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9927433f1b00) 00010000:00010000:0.0:1787853642.503717:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853642.503722:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055609 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.503749:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055609 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853642.503786:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136435968 00000100:00100000:3.0:1787853642.503800:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136435968 00000100:00100000:3.0:1787853642.503881:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 59 00000100:00100000:3.0:1787853642.503893:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136435968:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787853642.503921:0:11669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853642.503944:0:11669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb05561e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2277 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787853642.503996:0:11669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853642.504036:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=336s v=(0 0) 00010000:00010000:3.0:1787853642.504042:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853642.504064:0:11669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb05561e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2277 expref: 6 pid: 11669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.504095:0:11669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb05561e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2277 expref: 6 pid: 11669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.504110:0:11669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064d400, rc 0) 00000100:00100000:3.0:1787853642.505043:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2365:x1874700136435968:12345-192.168.206.10@tcp:101:bash.0 Request processed in 1146us (2091us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853642.505654:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 59 00000100:00100000:2.0:1787853642.516431:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853642.516582:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136436096 00000100:00100000:0.0:1787853642.516595:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136436096 00000100:00100000:0.0:1787853642.516669:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:0.0:1787853642.516719:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dad9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:11576:x1874700136436096:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787853642.516739:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853642.516762:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9bebc7b/0xcf1365f7cb055625 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd227e expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.516811:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb05561e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2277 expref: 7 pid: 11669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.516821:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853642.516826:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853642.516832:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9bebc7b/0xcf1365f7cb055625 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd227e expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.516876:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb05561e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2277 expref: 7 pid: 11669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.516891:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb05561e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2277 expref: 7 pid: 11669 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853642.516907:0:6671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dadfc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1874700152152704:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787853642.517043:0:6671:0:(client.c:2715:ptlrpc_set_wait()) set ffff992761d3e900 going to sleep for 11 seconds 00000100:00100000:2.0:1787853642.527814:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853642.528953:0:6671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dadfc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1874700152152704:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787853642.529000:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9bebc7b/0xcf1365f7cb055625 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd227e expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.529027:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a9c00, rc 0) 00000100:00100000:0.0:1787853642.529529:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dad9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:11576:x1874700136436096:12345-192.168.206.10@tcp:101:bash.0 Request processed in 12810us (13110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853642.529541:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:3.0:1787853642.529882:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136436224 00000100:00100000:3.0:1787853642.529892:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136436224 00010000:00010000:3.0:1787853642.529936:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb05561e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2277 expref: 7 pid: 11669 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853642.529986:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:3.0:1787853642.529997:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dad8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2365:x1874700136436224:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853642.530087:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853642.530391:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb05561e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2277 expref: 7 pid: 11669 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.530435:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb05561e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2277 expref: 7 pid: 11669 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.530466:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b163a7d2/0xcf1365f7cb05561e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2277 expref: 7 pid: 11669 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.530484:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853642.530489:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853642.530499:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9bebc7b/0xcf1365f7cb055625 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd227e expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.530511:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9bebc7b/0xcf1365f7cb055625 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd227e expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.530554:0:5810:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f9bebc7b/0xcf1365f7cb055625 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd227e expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853642.530570:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276de18f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5810:1874700152152832:192.168.206.10@tcp:105: 00000100:00100000:3.0:1787853642.530651:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927463b3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787853642.541317:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853642.541754:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136436480 00000100:00100000:1.0:1787853642.541766:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136436480 00000100:00100000:1.0:1787853642.541836:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 55 00000100:00100000:1.0:1787853642.541847:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dada940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+38:11576:x1874700136436480:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:1.0:1787853642.542318:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dada940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+39:11576:x1874700136436480:12345-192.168.206.10@tcp:35:bash.0 Request processed in 472us (1014us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1787853642.542326:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 55 00000100:00100000:3.0:1787853642.546490:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276de18f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5810:1874700152152832:192.168.206.10@tcp:105: 00010000:00010000:3.0:1787853642.546527:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853642.546629:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dad8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2365:x1874700136436224:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 16626us (18823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853642.546642:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:1.0:1787853642.567282:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dad9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152152960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853642.567396:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853642.567849:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152152960 00000100:00100000:2.0:1787853642.567861:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152152960 00000100:00100000:2.0:1787853642.567947:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787853642.567958:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1874700152152960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853642.568005:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853642.568616:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1874700152152960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 658us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853642.568625:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787853642.568771:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dad9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152152960:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787853642.569242:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787853642.630552:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853642.730604:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853642.730837:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136436608 00000100:00100000:1.0:1787853642.730850:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136436608 00000100:00100000:1.0:1787853642.730927:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 200 00000100:00100000:1.0:1787853642.730938:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dad83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+39:11592:x1874700136436608:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787853642.730969:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853642.730997:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05562c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2285 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.731093:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055633 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.731110:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.731148:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853642.731227:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787853642.731231:0:5825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853642.731256:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.731287:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05562c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2285 expref: 41 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.731307:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055633 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2285 expref: 40 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.731315:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:1.0:1787853642.731318:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787853642.731322:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766197e00, rc 0) 00000100:00100000:1.0:1787853642.731465:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dad83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+40:11592:x1874700136436608:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 528us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853642.731473:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 200 00000100:00100000:1.0:1787853642.735068:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853642.735155:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136436864 00000100:00100000:0.0:1787853642.735167:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136436864 00000100:00100000:0.0:1787853642.735238:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 201 00000100:00100000:0.0:1787853642.735248:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+40:11592:x1874700136436864:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787853642.735273:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853642.735298:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05563a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd228c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.735448:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055641 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.735463:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.735477:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853642.735513:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787853642.735726:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb05563a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd228c expref: 43 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.735748:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055641 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd228c expref: 42 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.735758:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9927433f1900) 00010000:00010000:0.0:1787853642.735761:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853642.735765:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a9600, rc 0) 00000100:00100000:0.0:1787853642.735835:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+42:11592:x1874700136436864:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 588us (797us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1787853642.735843:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 201 00000100:00100000:2.0:1787853642.739543:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853642.739592:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853642.739701:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136437248 00000100:00100000:3.0:1787853642.739711:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136437248 00000100:00100000:3.0:1787853642.739792:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:3.0:1787853642.739803:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+42:2363:x1874700136437248:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853642.739824:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853642.739856:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9600/0xcf1365f7cb055641 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd228c expref: 42 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.739876:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9927433f1900) 00010000:00010000:3.0:1787853642.739882:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853642.739952:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+41:2363:x1874700136437248:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 151us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853642.739961:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:1.0:1787853642.741235:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136437120 00000100:00100000:1.0:1787853642.741248:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136437120 00000100:00100000:1.0:1787853642.741303:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 202 00000100:00100000:1.0:1787853642.741311:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dad8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+41:11592:x1874700136437120:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787853642.741338:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853642.741362:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05564f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2293 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.741521:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055656 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.741537:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.741550:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853642.741565:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787853642.742039:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05564f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2293 expref: 44 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.742073:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2293 expref: 43 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.742083:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9927433f1900) 00010000:00010000:1.0:1787853642.742086:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787853642.742089:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766197c00, rc 0) 00000100:00100000:1.0:1787853642.742219:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dad8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+43:11592:x1874700136437120:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 907us (2691us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1787853642.742227:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 202 00000100:00100000:2.0:1787853642.757241:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853642.757425:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136437376 00000100:00100000:1.0:1787853642.757437:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136437376 00000100:00100000:1.0:1787853642.757512:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:1.0:1787853642.757523:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+6:2365:x1874700136437376:12345-192.168.206.10@tcp:1:lfs.0 00010000:00010000:1.0:1787853642.757584:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb055664 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.757626:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9bebc7b/0xcf1365f7cb055625 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd227e expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.757636:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787853642.757640:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787853642.757645:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb055664 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.757744:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9bebc7b/0xcf1365f7cb055625 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd227e expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.757760:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9bebc7b/0xcf1365f7cb055625 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd227e expref: 6 pid: 6671 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853642.757777:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99264227d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6673:1874700152153088:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787853642.757900:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d5c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853642.760391:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99264227d2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6673:1874700152153088:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787853642.760464:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb055664 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853642.762594:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853642.762743:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136437504 00000100:00100000:0.0:1787853642.762756:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136437504 00002000:00100000:0.0:1787853642.762825:0:6676:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff99276dad8000 x1874700136437504/t0(0) o4->0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp:63/0 lens 504/0 e 0 to 0 dl 1787853653 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787853642.762839:0:6676:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99276dad8000 with x1874700136437504 ext(0->8) 00010000:00010000:0.0:1787853642.762850:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f9bebc7b/0xcf1365f7cb055625 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd227e expref: 7 pid: 6671 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.762869:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f9bebc7b/0xcf1365f7cb055625 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd227e expref: 7 pid: 6671 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853642.762878:0:6676:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99276dad8000 00000100:00100000:0.0:1787853642.762909:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:0.0:1787853642.762938:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2364:x1874700136437504:12345-192.168.206.10@tcp:4:lfs.0 00000100:00100000:0.0:1787853642.763579:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:2364:x1874700136437504:12345-192.168.206.10@tcp:4:lfs.0 Request processed in 640us (997us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787853642.763589:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 3 00002000:00100000:0.0:1787853642.763598:0:6676:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff99276dad8000 x1874700136437504/t4294967308(0) o4->0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp:63/0 lens 504/448 e 0 to 0 dl 1787853653 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787853642.763608:0:6676:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99276dad8000 with x1874700136437504 ext(0->8) 00010000:00010000:0.0:1787853642.763614:0:6676:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f9bebc7b/0xcf1365f7cb055625 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd227e expref: 9 pid: 6671 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.763629:0:6676:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f9bebc7b/0xcf1365f7cb055625 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd227e expref: 9 pid: 6671 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787853642.763637:0:6676:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99276dad8000 00000100:00100000:3.0:1787853642.766450:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853642.766589:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136437632 00000100:00100000:0.0:1787853642.766601:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136437632 00010000:00010000:0.0:1787853642.767223:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9bebc7b/0xcf1365f7cb055625 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd227e expref: 9 pid: 6671 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853642.767321:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:0.0:1787853642.767335:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de18f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:2363:x1874700136437632:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853642.767356:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787853642.767382:0:5809:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787853642.767385:0:5809:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787853642 00002000:00010000:0.0:1787853642.767388:0:5809:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787853642 00002000:00010000:0.0:1787853642.767420:0:5809:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787853642 00010000:00010000:0.0:1787853642.767429:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9bebc7b/0xcf1365f7cb055625 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd227e expref: 9 pid: 6671 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.767445:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9bebc7b/0xcf1365f7cb055625 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd227e expref: 9 pid: 6671 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.767478:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9bebc7b/0xcf1365f7cb055625 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd227e expref: 9 pid: 6671 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.767499:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787853642.767504:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787853642.767512:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb055664 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.767523:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb055664 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.767561:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853642.767631:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de18f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2363:x1874700136437632:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 300us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853642.767639:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 77 00010000:00010000:1.0:1787853642.767706:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb055664 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.767717:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb055664 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.767753:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb055664 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.767762:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb055664 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.767770:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb055664 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.767777:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197600 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:1.0:1787853642.767782:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb055664 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.767792:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb055664 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.767805:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb055664 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.767812:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059e31d64/0xcf1365f7cb055664 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853642.767864:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2365:x1874700136437376:12345-192.168.206.10@tcp:1:lfs.0 Request processed in 10343us (10644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853642.767873:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:2.0:1787853642.776022:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853642.776192:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136437888 00000100:00100000:1.0:1787853642.776205:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136437888 00000100:00100000:1.0:1787853642.776278:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 56 00000100:00100000:1.0:1787853642.776290:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274f707450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+43:11592:x1874700136437888:12345-192.168.206.10@tcp:35:lfs.0 00000004:00010000:1.0:1787853642.776374:0:5828:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2293 expref: 43 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787853642.776737:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1787853642.776901:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1787853642.777386:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1787853642.777894:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb05566b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.777921:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb055610 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2270 expref: 47 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.777934:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb05566b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.777979:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb055610 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2270 expref: 47 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.777994:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb055610 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2270 expref: 47 pid: 7618 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853642.778010:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99264227d2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5828:1874700152153216:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787853642.780755:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d5c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853642.787872:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853642.788571:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99264227d2c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5828:1874700152153216:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787853642.788612:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb05566b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853642.789354:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136438016 00000100:00100000:0.0:1787853642.789366:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136438016 00010000:00010000:0.0:1787853642.789417:0:8433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb055610 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2270 expref: 48 pid: 7618 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853642.789504:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 78 00000100:00100000:0.0:1787853642.789530:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dad92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+48:2364:x1874700136438016:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853642.789549:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853642.789557:0:8433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb055610 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2270 expref: 48 pid: 7618 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.789571:0:8433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb055610 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2270 expref: 48 pid: 7618 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.789597:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb055610 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2270 expref: 48 pid: 7618 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.789615:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9927433f1900) 00010000:00010000:0.0:1787853642.789633:0:8433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb05566b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.789644:0:8433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb05566b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.789660:0:8433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb05566b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.789731:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853642.789804:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dad92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+47:2364:x1874700136438016:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 276us (1947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853642.789813:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 78 00010000:00010000:3.0:1787853642.789877:0:5828:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb05566b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.789886:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb05566b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787853642.790042:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1787853642.790290:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1787853642.790419:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276de1bc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5828:1874700152153344:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787853642.790494:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853642.790568:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152153344 00000100:00100000:3.0:1787853642.790575:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152153344 00000100:00100000:3.0:1787853642.790625:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787853642.790633:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5828:x1874700152153344:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787853642.790735:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5828:x1874700152153344:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 102us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853642.790742:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787853642.790764:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787853642.790776:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927463b3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853642.790801:0:5828:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1787853642.790807:0:5828:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1787853642.790830:0:5828:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99276dd35a40, transno 4294967307 00000100:00100000:3.0:1787853642.790846:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276de1bc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5828:1874700152153344:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787853642.791468:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1787853642.791535:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276de1bc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5828:1874700152153472:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787853642.791576:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853642.791611:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152153472 00000100:00100000:3.0:1787853642.791617:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152153472 00000100:00100000:3.0:1787853642.791646:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787853642.791654:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5828:x1874700152153472:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787853642.791851:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5828:x1874700152153472:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 196us (272us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787853642.791858:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787853642.791881:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927463b3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787853642.791906:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276de1bc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5828:1874700152153472:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787853642.791953:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1787853642.791991:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb05566b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.792010:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb05566b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.792019:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb05566b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.792025:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853642.792030:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb05566b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.792038:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb05566b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.792068:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9927433f1900) 00010000:00010000:3.0:1787853642.792071:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787853642.792077:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb05566b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.792084:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb05566b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787853642.792284:0:5828:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787853642.792387:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1787853642.793006:0:5828:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337090331561ns, next at 338089723212ns, rc = 0 00000001:00080000:3.0:1787853642.793021:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1787853642.793095:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9927433f1900) 00010000:00010000:3.0:1787853642.793099:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787853642.793108:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055656 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2293 expref: 51 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853642.793416:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274f707450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+50:11592:x1874700136437888:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 17127us (17407us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1787853642.793426:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 56 00000020:00080000:3.0:1787853642.793431:0:5828:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787853642.795922:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853642.796006:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136438144 00000100:00100000:0.0:1787853642.796017:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136438144 00000100:00100000:0.0:1787853642.796183:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 203 00000100:00100000:0.0:1787853642.796195:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+50:11592:x1874700136438144:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787853642.796242:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853642.796268:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9c00/0xcf1365f7cb055672 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd229a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.796342:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9c00/0xcf1365f7cb055672 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd229a expref: 51 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.796358:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9c00/0xcf1365f7cb055672 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd229a expref: 51 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.796379:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:0.0:1787853642.796382:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787853642.796386:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a9c00, rc 0) 00000100:00100000:0.0:1787853642.796503:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+51:11592:x1874700136438144:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 310us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853642.796511:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 203 00000100:00100000:3.0:1787853642.801074:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853642.801181:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136438400 00000100:00100000:0.0:1787853642.801194:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136438400 00000100:00100000:0.0:1787853642.801261:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:0.0:1787853642.801274:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+51:11592:x1874700136438400:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:0.0:1787853642.801597:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+52:11592:x1874700136438400:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 325us (548us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1787853642.801606:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 57 00000100:00100000:2.0:1787853642.884882:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853642.884988:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136438528 00000100:00100000:1.0:1787853642.885002:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136438528 00000100:00100000:1.0:1787853642.885114:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 204 00000100:00100000:1.0:1787853642.885126:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dad8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+52:11602:x1874700136438528:12345-192.168.206.10@tcp:34:lfs.0 00010000:00010000:1.0:1787853642.885232:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb055679 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885254:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb055679 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885268:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb055679 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885286:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055680 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885293:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885300:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885436:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb055687 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885445:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb055687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885453:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb055687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787853642.885507:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb055687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885521:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb055679 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885534:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb055679 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885542:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb055679 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885549:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853642.885553:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb055679 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885561:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb055679 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885576:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:1.0:1787853642.885579:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853642.885585:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb055679 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885592:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb055679 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885609:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885615:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055680 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885621:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055680 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885626:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853642.885634:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055680 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885641:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055680 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885650:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9927433f1500) 00010000:00010000:1.0:1787853642.885653:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853642.885656:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055680 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885662:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055680 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885816:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb055687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885824:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb055687 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885830:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb055687 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885835:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853642.885839:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb055687 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885845:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb055687 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885853:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:1.0:1787853642.885855:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853642.885864:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb055687 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.885870:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb055687 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853642.885969:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dad8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+52:11602:x1874700136438528:12345-192.168.206.10@tcp:34:lfs.0 Request processed in 842us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853642.885978:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 204 00000100:00100000:2.0:1787853642.919436:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853642.919604:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136438784 00000100:00100000:1.0:1787853642.919617:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136438784 00000100:00100000:1.0:1787853642.919721:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 205 00000100:00100000:1.0:1787853642.919732:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+52:11605:x1874700136438784:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787853642.919770:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853642.919798:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb05568e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd22a1 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.919892:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055695 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.919908:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055695 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.919922:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055695 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.919939:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05569c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.919946:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05569c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.919975:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05569c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.920264:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0556a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.920274:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0556a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.920282:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0556a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853642.920292:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787853642.920524:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055695 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.920533:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055695 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.920540:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055695 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.920546:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853642.920551:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055695 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.920560:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055695 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.920573:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:1.0:1787853642.920577:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853642.920590:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055695 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.920597:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055695 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.920614:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05569c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.920620:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05569c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.920626:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05569c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.920631:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853642.920634:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05569c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.920639:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05569c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.920647:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9927433f1500) 00010000:00010000:1.0:1787853642.920650:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853642.920653:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05569c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.920659:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb05569c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.921140:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb05568e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22a1 expref: 55 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.921171:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0556a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22a1 expref: 54 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.921179:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:1.0:1787853642.921181:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787853642.921184:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196600, rc 0) 00000100:00100000:1.0:1787853642.921313:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+54:11605:x1874700136438784:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1582us (1890us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1787853642.921322:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 205 00000100:00100000:3.0:1787853642.925326:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853642.925432:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136438912 00000100:00100000:1.0:1787853642.925446:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136438912 00000100:00100000:1.0:1787853642.925518:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 206 00000100:00100000:1.0:1787853642.925530:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+54:11605:x1874700136438912:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:1.0:1787853642.925661:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.925921:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.925938:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.925974:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.925982:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.926005:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.926011:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853642.926015:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.926023:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.926037:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:1.0:1787853642.926040:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787853642.926045:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.926124:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853642.926261:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+54:11605:x1874700136438912:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 732us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853642.926271:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 206 00000100:00100000:2.0:1787853642.928400:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853642.928498:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136439168 00000100:00100000:0.0:1787853642.928511:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136439168 00000100:00100000:0.0:1787853642.928623:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 58 00000100:00100000:0.0:1787853642.928634:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dada940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+54:11605:x1874700136439168:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:0.0:1787853642.929013:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dada940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+55:11605:x1874700136439168:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 380us (622us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1787853642.929022:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 58 00000100:00100000:2.0:1787853642.985283:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853642.985553:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136439424 00000100:00100000:0.0:1787853642.985569:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136439424 00000100:00100000:0.0:1787853642.985649:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 207 00000100:00100000:0.0:1787853642.985661:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dad9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+55:11615:x1874700136439424:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:0.0:1787853642.986450:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853642.986456:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787853642.986494:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055633 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2285 expref: 55 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.986519:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:0.0:1787853642.986523:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853642.986541:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb0556b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd22a8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.986665:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0556bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.986722:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0556a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22a1 expref: 55 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.986732:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0556bf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.986841:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0556a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22a1 expref: 55 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853642.986878:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0556a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22a1 expref: 55 pid: 7618 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853642.986894:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dadfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5824:1874700152153600:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787853642.987076:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff992761d3e900 going to sleep for 11 seconds 00000100:00100000:0.0:1787853642.993851:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dadfc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5824:1874700152153600:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787853642.993896:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0556bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853642.994568:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853642.994706:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136439552 00000100:00100000:3.0:1787853642.994718:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136439552 00010000:00010000:3.0:1787853642.994776:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0556a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22a1 expref: 56 pid: 7618 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853642.994815:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 79 00000100:00100000:3.0:1787853642.994826:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+56:2365:x1874700136439552:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853642.994846:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853642.994854:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0556a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22a1 expref: 56 pid: 7618 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.994867:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0556a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22a1 expref: 56 pid: 7618 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.994894:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196600/0xcf1365f7cb0556a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22a1 expref: 56 pid: 7618 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.994913:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:3.0:1787853642.994919:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0556bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.994946:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0556bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.994956:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0556bf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853642.994998:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853642.995248:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0556bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.995257:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0556bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853642.995282:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787853642.995490:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8400/0xcf1365f7cb0556b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22a8 expref: 57 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.995517:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0556bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22a8 expref: 56 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853642.995525:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:1.0:1787853642.995528:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787853642.995530:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a8e00, rc 0) 00000100:00100000:3.0:1787853642.995634:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+56:2365:x1874700136439552:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 808us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853642.995643:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 79 00000100:00100000:1.0:1787853642.996029:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dad9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+55:11615:x1874700136439424:12345-192.168.206.10@tcp:101:bash.0 Request processed in 10369us (10755us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1787853642.996038:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 207 00000100:00100000:2.0:1787853642.999386:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853642.999541:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136439808 00000100:00100000:1.0:1787853642.999552:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136439808 00000100:00100000:1.0:1787853642.999665:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 208 00000100:00100000:1.0:1787853642.999714:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dada580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+55:11615:x1874700136439808:12345-192.168.206.10@tcp:36:bash.0 00010000:00010000:1.0:1787853643.000344:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853643.000364:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853643.000378:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787853643.001014:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1787853643.001061:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059c17d7b reply state 0000000091f31a02 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853643.001072:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787853643.001453:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dada580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+58:11615:x1874700136439808:12345-192.168.206.10@tcp:36:bash.0 Request processed in 1774us (2076us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1787853643.001463:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 208 00000020:00080000:1.0:1787853643.001471:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787853643.005255:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853643.005701:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136439936 00000100:00100000:1.0:1787853643.005715:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136439936 00000100:00100000:1.0:1787853643.005829:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 209 00000100:00100000:1.0:1787853643.005841:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+58:11615:x1874700136439936:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:1.0:1787853643.005874:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853643.005904:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0556d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd22af expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853643.006016:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb0556db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853643.006033:0:7618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0556bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22a8 expref: 59 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853643.006040:0:7618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556cd lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853643.006064:0:7618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb0556db lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853643.006086:0:7618:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853643.006118:0:7618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0556bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22a8 expref: 59 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853643.006161:0:7618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0556bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22a8 expref: 59 pid: 5824 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853643.006178:0:7618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99264227e580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7618:1874700152153728:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787853643.006279:0:7618:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d5c180 going to sleep for 11 seconds 00010000:00010000:3.0:1787853643.006411:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853643.006423:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853643.006431:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853643.006438:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853643.006441:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853643.006448:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853643.006467:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:3.0:1787853643.006480:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853643.006484:0:3283:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb0556db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853643.006506:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853643.006513:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb0556cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787853643.006597:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853643.009995:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853643.010134:0:7618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99264227e580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7618:1874700152153728:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787853643.010172:0:7618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb0556db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853643.010185:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136440064 00000100:00100000:2.0:1787853643.010194:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136440064 00010000:00010000:2.0:1787853643.010241:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0556bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22a8 expref: 59 pid: 5824 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853643.010288:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 80 00000100:00100000:2.0:1787853643.010298:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de19a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+59:2364:x1874700136440064:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853643.010318:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853643.010325:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0556bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22a8 expref: 59 pid: 5824 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.010339:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0556bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22a8 expref: 59 pid: 5824 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.010367:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8e00/0xcf1365f7cb0556bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22a8 expref: 59 pid: 5824 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.010386:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:2.0:1787853643.010392:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb0556db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.010521:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb0556db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.010548:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb0556db lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.010582:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853643.010623:0:7618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb0556db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853643.010633:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb0556db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853643.010720:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787853643.010727:0:7618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853643.010754:0:7618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb0556db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853643.010795:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb0556d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22af expref: 59 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853643.010803:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de19a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+59:2364:x1874700136440064:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 355us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853643.010816:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 80 00010000:00010000:1.0:1787853643.010816:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb0556db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22af expref: 58 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853643.010828:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:1.0:1787853643.010840:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787853643.010844:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766197600, rc 0) 00000100:00100000:1.0:1787853643.010877:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+57:11615:x1874700136439936:12345-192.168.206.10@tcp:101:bash.0 Request processed in 5038us (5636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853643.010887:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 209 00000100:00100000:2.0:1787853643.014217:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853643.014295:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136440320 00000100:00100000:3.0:1787853643.014312:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136440320 00000100:00100000:3.0:1787853643.014397:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 59 00000100:00100000:3.0:1787853643.014410:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+57:11615:x1874700136440320:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:3.0:1787853643.014787:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+58:11615:x1874700136440320:12345-192.168.206.10@tcp:35:bash.0 Request processed in 378us (584us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1787853643.014796:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 59 00000100:00100000:2.0:1787853643.057199:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853643.057316:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136440448 00000100:00100000:1.0:1787853643.057328:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136440448 00000100:00100000:2.0:1787853643.057503:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 210 00000100:00100000:2.0:1787853643.057517:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+58:11621:x1874700136440448:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787853643.057552:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853643.057584:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0556e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd22b6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.057704:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0556e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.057723:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0556e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.057736:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0556e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853643.057812:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787853643.057816:0:5826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853643.057844:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0556e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.057900:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0556e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22b6 expref: 60 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.057922:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0556e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22b6 expref: 59 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.057992:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:2.0:1787853643.057996:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853643.058000:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71a00, rc 0) 00000100:00100000:2.0:1787853643.058091:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+59:11621:x1874700136440448:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 578us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853643.058099:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 210 00000100:00100000:1.0:1787853643.060089:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853643.060170:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136440576 00000100:00100000:2.0:1787853643.060180:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136440576 00000100:00100000:2.0:1787853643.060244:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 211 00000100:00100000:2.0:1787853643.060256:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+59:11621:x1874700136440576:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787853643.060278:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853643.060301:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0556f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd22bd expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.060377:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0556f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.060393:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0556f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.060503:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0556f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.060537:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb0556fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.060546:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb0556fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.060553:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb0556fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.060837:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055705 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.060847:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.060855:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853643.060898:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787853643.060903:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853643.060925:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.060994:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.061004:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0556f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.061011:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0556f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.061029:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0556f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.061037:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853643.061041:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0556f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.061063:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0556f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.061078:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:2.0:1787853643.061081:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853643.061087:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0556f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.061094:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb0556f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.061109:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb0556fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.061115:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb0556fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.061121:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb0556fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.061127:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853643.061130:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb0556fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.061147:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb0556fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.061157:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff992743be3e00) 00010000:00010000:2.0:1787853643.061159:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853643.061162:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb0556fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.061169:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb0556fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.061207:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0556f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22bd expref: 61 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.061222:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055705 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22bd expref: 60 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.061230:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:2.0:1787853643.061233:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853643.061236:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71e00, rc 0) 00000100:00100000:2.0:1787853643.061370:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+60:11621:x1874700136440576:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1116us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853643.061377:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 211 00000100:00100000:3.0:1787853643.073346:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853643.073417:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853643.073539:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136440832 00000100:00100000:2.0:1787853643.073551:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136440832 00000100:00100000:2.0:1787853643.073624:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 212 00000100:00100000:2.0:1787853643.073635:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+60:11621:x1874700136440832:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787853643.073700:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853643.073726:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb05570c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd22c4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.073854:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055713 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.073871:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb0556db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22af expref: 61 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.073879:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055705 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22bd expref: 61 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.073889:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055713 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.073940:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055705 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22bd expref: 61 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.073956:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055705 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22bd expref: 61 pid: 5824 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853643.073971:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3ccb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5826:1874700152153856:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787853643.074105:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb0556db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22af expref: 61 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.074115:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb0556db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22af expref: 61 pid: 7618 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853643.074140:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3ce580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5826:1874700152153984:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787853643.074169:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d550c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853643.074250:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136440960 00000100:00100000:0.0:1787853643.074256:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136440960 00010000:00010000:0.0:1787853643.074288:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055705 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22bd expref: 62 pid: 5824 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853643.074324:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:0.0:1787853643.074333:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992766152450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+62:2365:x1874700136440960:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853643.074344:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853643.074350:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055705 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22bd expref: 62 pid: 5824 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853643.074363:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055705 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22bd expref: 62 pid: 5824 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853643.074383:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:0.0:1787853643.074395:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055713 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853643.074402:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055713 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853643.074409:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853643.074438:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992766152450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+62:2365:x1874700136440960:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 105us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853643.074445:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:1.0:1787853643.076956:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853643.077075:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136441088 00000100:00100000:3.0:1787853643.077086:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136441088 00010000:00010000:3.0:1787853643.077133:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb0556db lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22af expref: 62 pid: 7618 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853643.077176:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 82 00000100:00100000:3.0:1787853643.077186:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+62:2364:x1874700136441088:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853643.077201:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853643.077207:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb0556db lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22af expref: 62 pid: 7618 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853643.077243:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb0556db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22af expref: 62 pid: 7618 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853643.077270:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:3.0:1787853643.077276:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055713 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853643.077288:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055713 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853643.077296:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055713 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853643.077318:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853643.077398:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+62:2364:x1874700136441088:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 212us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853643.077406:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 82 00010000:00010000:2.0:1787853643.080802:0:5826:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.10@tcp) returned -22 from blocking AST (req@000000008194b2e9 x1874700152153856) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055705 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22bd expref: 61 pid: 5824 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.080835:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71e00/0xcf1365f7cb055705 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22bd expref: 61 pid: 5824 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853643.080855:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3ccb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5826:1874700152153856:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787853643.080879:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb0556db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22af expref: 60 pid: 7618 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853643.080890:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3ce580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5826:1874700152153984:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787853643.080983:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:2.0:1787853643.080994:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055713 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.081013:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055713 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.081019:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055713 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853643.081045:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787853643.081849:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb05570c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22c4 expref: 61 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.081889:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055713 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22c4 expref: 60 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853643.081898:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:2.0:1787853643.081901:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787853643.081904:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71c00, rc 0) 00000100:00100000:2.0:1787853643.082065:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+60:11621:x1874700136440832:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 8416us (8717us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787853643.082076:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 212 00000100:00100000:1.0:1787853643.088542:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853643.088826:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136441344 00000100:00100000:0.0:1787853643.088839:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136441344 00000100:00100000:1.0:1787853643.089030:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:1.0:1787853643.089042:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+60:11621:x1874700136441344:12345-192.168.206.10@tcp:103:lfs.0 00010000:00010000:1.0:1787853643.089131:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853643.089165:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9c00/0xcf1365f7cb055672 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd229a expref: 60 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853643.089190:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:1.0:1787853643.089196:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853643.089274:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+59:11621:x1874700136441344:12345-192.168.206.10@tcp:103:lfs.0 Request processed in 234us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853643.089284:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:1.0:1787853643.095433:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853643.095714:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136441472 00000100:00100000:0.0:1787853643.095726:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136441472 00000100:00100000:0.0:1787853643.095794:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 213 00000100:00100000:0.0:1787853643.095806:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+59:11621:x1874700136441472:12345-192.168.206.10@tcp:58:lfs.0 00010000:00010000:0.0:1787853643.095939:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055721 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853643.095961:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055721 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853643.095976:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055721 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787853643.096413:0:7618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1787853643.096659:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+59:11621:x1874700136441472:12345-192.168.206.10@tcp:58:lfs.0 Request processed in 795us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853643.096795:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 213 00000100:00100000:3.0:1787853643.102954:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853643.103407:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136441600 00000100:00100000:1.0:1787853643.103419:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136441600 00000100:00100000:1.0:1787853643.103497:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 214 00000100:00100000:1.0:1787853643.103508:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+59:11621:x1874700136441600:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787853643.103535:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853643.103579:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055728 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd22cb expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853643.103657:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055721 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853643.103669:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055728 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22cb expref: 60 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853643.103965:0:5825:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055721 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853643.103984:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055728 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22cb expref: 60 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853643.104000:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:3.0:1787853643.104004:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787853643.104009:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055728 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22cb expref: 60 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853643.104031:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766197a00, rc 0) 00000100:00100000:3.0:1787853643.104368:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+60:11621:x1874700136441600:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 860us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853643.104377:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 214 00010000:00010000:3.0:1787853643.654346:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787853644.037996:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787853644.038009:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787853644.038145:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1787853644.038153:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787853644.038330:0:11666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99264227c3c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874700152154112:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787853644.038736:0:11666:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d5c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787853644.049926:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853644.050650:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136441728 00000100:00100000:2.0:1787853644.050664:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136441728 00000100:00100000:2.0:1787853644.050780:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 215 00000100:00100000:2.0:1787853644.050793:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+61:11622:x1874700136441728:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787853644.050856:0:5824:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787853644.051022:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+61:11622:x1874700136441728:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 232us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853644.051031:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 215 00000100:00100000:1.0:1787853644.052619:0:11666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99264227c3c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874700152154112:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787853644.053837:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853644.054119:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136441856 00000100:00100000:1.0:1787853644.054129:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136441856 00000100:00100000:1.0:1787853644.054235:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 216 00000100:00100000:1.0:1787853644.054246:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+60:11622:x1874700136441856:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787853644.054339:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb05572f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054357:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb05572f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054372:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb05572f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054410:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055736 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054417:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055736 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054424:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055736 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054448:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb05573d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054456:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb05573d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054461:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb05573d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853644.054505:0:5826:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787853644.054509:0:5826:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853644.054523:0:5826:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb05573d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054546:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb05572f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054553:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb05572f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054561:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb05572f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054577:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853644.054582:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb05572f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054590:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb05572f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054604:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff992761dc9700) 00010000:00010000:1.0:1787853644.054607:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853644.054612:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb05572f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054619:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb05572f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054633:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055736 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054640:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055736 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054646:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055736 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054651:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853644.054654:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055736 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054659:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055736 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054715:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9927433f1500) 00010000:00010000:1.0:1787853644.054719:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853644.054722:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055736 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054729:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055736 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054744:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb05573d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054749:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb05573d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054756:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb05573d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054762:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853644.054764:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb05573d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054770:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb05573d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054776:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:1.0:1787853644.054778:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853644.054780:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb05573d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.054786:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb05573d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853644.054892:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+60:11622:x1874700136441856:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 Request processed in 647us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853644.054901:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 216 00000100:00100000:3.0:1787853644.065296:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853644.065769:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136442112 00000100:00100000:2.0:1787853644.065782:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136442112 00000100:00100000:2.0:1787853644.065862:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 217 00000100:00100000:2.0:1787853644.065873:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dd35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+60:11622:x1874700136442112:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853644.065901:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853644.065930:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055744 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd22d2 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.066102:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb05574b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.066121:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb05574b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.066135:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb05574b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853644.066148:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787853644.066274:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb05574b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.066282:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb05574b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.066288:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb05574b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.066294:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853644.066299:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb05574b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.066306:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb05574b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.066320:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:2.0:1787853644.066323:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787853644.066328:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb05574b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.066346:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb05574b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.066398:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055744 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22d2 expref: 62 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.066411:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff992761dc9700) 00010000:00010000:2.0:1787853644.066413:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787853644.066418:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055744 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22d2 expref: 62 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.066427:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70e00, rc 0) 00000100:00100000:2.0:1787853644.067397:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dd35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+61:11622:x1874700136442112:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 1518us (2106us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1787853644.067409:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 217 00000100:00100000:3.0:1787853644.078461:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853644.078630:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136442240 00000100:00100000:2.0:1787853644.078643:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136442240 00000100:00100000:2.0:1787853644.078987:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 218 00000100:00100000:2.0:1787853644.078999:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bf5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+61:11622:x1874700136442240:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787853644.079166:0:5825:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787853644.079351:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bf5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+61:11622:x1874700136442240:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 354us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853644.079360:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 218 00000100:00100000:3.0:1787853644.082478:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853644.082800:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136442496 00000100:00100000:0.0:1787853644.082832:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136442496 00000100:00100000:0.0:1787853644.082909:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 219 00000100:00100000:0.0:1787853644.082921:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+61:11622:x1874700136442496:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853644.082950:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853644.082953:0:7618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787853644.082987:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0556e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22b6 expref: 61 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.083231:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:0.0:1787853644.083239:0:7618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787853644.083257:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055759 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd22d9 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787853644.084319:0:7618:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1787853644.084785:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb055760 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.084805:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb055760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.084820:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb055760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.084895:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055759 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22d9 expref: 63 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.084916:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb055760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22d9 expref: 62 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.084944:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff992761dc9b00) 00010000:00010000:0.0:1787853644.084947:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787853644.084950:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a9200, rc 0) 00000100:00100000:0.0:1787853644.085497:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+62:11622:x1874700136442496:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 2123us (2579us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1787853644.085509:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 219 00000100:00100000:3.0:1787853644.089754:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853644.089823:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136442752 00000100:00100000:1.0:1787853644.089836:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136442752 00000100:00100000:1.0:1787853644.089914:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 220 00000100:00100000:1.0:1787853644.089927:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927500d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+62:11622:x1874700136442752:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787853644.090004:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853644.090057:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9200/0xcf1365f7cb055760 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22d9 expref: 62 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.090085:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff992761dc9b00) 00010000:00010000:1.0:1787853644.090099:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853644.090126:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb05576e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.090143:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb05576e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.090156:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb05576e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.090224:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055775 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc5534dcd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.090233:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055775 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc5534dcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.090241:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055775 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc5534dcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.090358:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb05576e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.090366:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb05576e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.090373:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb05576e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.090380:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853644.090385:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb05576e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.090393:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb05576e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.090402:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:1.0:1787853644.090405:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853644.090409:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb05576e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.090416:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb05576e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.090426:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055775 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc5534dcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.090432:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055775 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc5534dcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.090437:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055775 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc5534dcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.090449:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853644.090452:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055775 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc5534dcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.090458:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055775 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc5534dcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.090467:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc5534dcd (ffff9927433f1500) 00010000:00010000:1.0:1787853644.090469:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853644.090472:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055775 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc5534dcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.090479:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055775 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc5534dcd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853644.090840:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927500d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+61:11622:x1874700136442752:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 914us (1099us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787853644.090850:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 220 00000100:00100000:3.0:1787853644.095452:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853644.095562:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136442880 00000100:00100000:2.0:1787853644.095575:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136442880 00000100:00100000:2.0:1787853644.095647:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 221 00000100:00100000:2.0:1787853644.095668:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+61:11622:x1874700136442880:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853644.095728:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853644.095760:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb05577c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd22e0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.095806:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb055783 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.095822:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb055783 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.095836:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb055783 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.095968:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb05577c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22e0 expref: 63 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.095990:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb055783 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22e0 expref: 62 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.096000:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff992743be3e00) 00010000:00010000:2.0:1787853644.096018:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787853644.096022:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70c00, rc 0) 00000100:00100000:2.0:1787853644.096099:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+62:11622:x1874700136442880:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 434us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853644.096107:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 221 00000100:00100000:3.0:1787853644.100724:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853644.102248:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136443136 00000100:00100000:1.0:1787853644.102270:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136443136 00000100:00100000:1.0:1787853644.102397:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 222 00000100:00100000:1.0:1787853644.102411:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+62:11622:x1874700136443136:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787853644.102616:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb05578a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.102637:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb05578a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.102651:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb05578a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787853644.103200:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1787853644.103212:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338400538304ns, next at 339400534993ns, rc = 0 00000004:00010000:1.0:1787853644.103324:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2ba3ee8 reply state 00000000bcc7cf60 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb05578a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853644.103336:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787853644.103491:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+64:11622:x1874700136443136:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 1081us (2817us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1787853644.103500:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 222 00000100:00100000:3.0:1787853644.113115:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00010000:00010000:0.0:1787853644.113259:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb05578a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.113275:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb05578a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.113283:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb05578a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.113290:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853644.113295:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb05578a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.113304:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb05578a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.113325:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff992743be3e00) 00010000:00010000:0.0:1787853644.113329:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787853644.113335:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb05578a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.113341:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb05578a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853644.115583:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136443264 00000100:00100000:2.0:1787853644.115980:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136443264 00000100:00100000:2.0:1787853644.116146:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 223 00000100:00100000:2.0:1787853644.116177:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+63:11622:x1874700136443264:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853644.116210:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853644.116236:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055791 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd22e7 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.116317:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055791 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22e7 expref: 64 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.116336:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055791 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22e7 expref: 64 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.116360:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff992743be3e00) 00010000:00010000:2.0:1787853644.116364:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787853644.116369:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70e00, rc 0) 00000100:00100000:2.0:1787853644.117633:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+64:11622:x1874700136443264:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 1453us (4525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853644.117645:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 223 00000100:00100000:1.0:1787853644.124612:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853644.124804:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136443392 00000100:00100000:0.0:1787853644.124818:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136443392 00000100:00100000:0.0:1787853644.124909:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00100000:0.0:1787853644.124922:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:2365:x1874700136443392:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787853644.125404:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+10:2365:x1874700136443392:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 483us (803us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787853644.125415:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00080000:1.0:1787853644.125490:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853644.127913:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853644.128065:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136443648 00000100:00100000:1.0:1787853644.128076:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136443648 00000100:00100000:1.0:1787853644.128144:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:1.0:1787853644.128155:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+64:11622:x1874700136443648:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787853644.128441:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+65:11622:x1874700136443648:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 287us (541us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787853644.128450:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 60 00000100:00100000:2.0:1787853644.134469:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853644.134828:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136443904 00000100:00100000:3.0:1787853644.134850:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136443904 00000100:00100000:3.0:1787853644.134925:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 224 00000100:00100000:3.0:1787853644.134938:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+65:11622:x1874700136443904:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787853644.135109:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+65:11622:x1874700136443904:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 173us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853644.135117:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 224 00000100:00100000:3.0:1787853644.139777:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853644.139914:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136444032 00000100:00100000:1.0:1787853644.139926:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136444032 00000100:00100000:1.0:1787853644.140001:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 225 00000100:00100000:1.0:1787853644.140013:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+65:11622:x1874700136444032:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853644.140039:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853644.140076:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb055798 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd22ee expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.140195:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb05579f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.140212:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb05579f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.140226:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb05579f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853644.140272:0:7618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853644.140297:0:7618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb05579f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.140327:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb055798 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22ee expref: 67 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.140349:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb05579f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22ee expref: 66 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.140358:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff992743be3e00) 00010000:00010000:1.0:1787853644.140362:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787853644.140366:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766197200, rc 0) 00000100:00100000:1.0:1787853644.140443:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+66:11622:x1874700136444032:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 432us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853644.140451:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 225 00000100:00100000:2.0:1787853644.144611:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853644.144863:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136444160 00000100:00100000:3.0:1787853644.144875:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136444160 00000100:00100000:3.0:1787853644.144954:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00100000:3.0:1787853644.144987:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+10:2365:x1874700136444160:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787853644.145010:0:11669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853644.145038:0:11669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b163a7d2/0xcf1365f7cb0557a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd22f5 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787853644.145087:0:11669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a907b4c, blocks: 0x1 00010000:00010000:3.0:1787853644.145112:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=338s v=(0 0) 00010000:00010000:3.0:1787853644.145118:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853644.145129:0:11669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b163a7d2/0xcf1365f7cb0557a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22f5 expref: 11 pid: 11669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.145160:0:11669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b163a7d2/0xcf1365f7cb0557a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22f5 expref: 11 pid: 11669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.145177:0:11669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064d400, rc 0) 00000100:00100000:3.0:1787853644.145260:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+11:2365:x1874700136444160:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 278us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853644.145268:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00100000:2.0:1787853644.149885:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853644.150011:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136444416 00000100:00100000:1.0:1787853644.150023:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136444416 00000100:00100000:1.0:1787853644.150110:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 226 00000100:00100000:1.0:1787853644.150141:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+66:11622:x1874700136444416:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787853644.150279:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+66:11622:x1874700136444416:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 141us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853644.150287:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 226 00000100:00100000:1.0:1787853644.154438:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853644.154603:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136444544 00000100:00100000:2.0:1787853644.154616:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136444544 00000100:00100000:2.0:1787853644.154717:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 64 00000100:00100000:2.0:1787853644.154730:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+11:11622:x1874700136444544:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853644.154754:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853644.154780:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb0557ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd22fc expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.154858:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b163a7d2/0xcf1365f7cb0557a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22f5 expref: 12 pid: 11669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.154870:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853644.154875:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853644.154883:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb0557ad lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22fc expref: 12 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.154925:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b163a7d2/0xcf1365f7cb0557a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22f5 expref: 12 pid: 11669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.154943:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b163a7d2/0xcf1365f7cb0557a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22f5 expref: 12 pid: 11669 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853644.154961:0:6671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3cf840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6671:1874700152154240:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787853644.155098:0:6671:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d55480 going to sleep for 11 seconds 00000100:00100000:0.0:1787853644.157375:0:6671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3cf840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6671:1874700152154240:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787853644.157425:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb0557ad lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22fc expref: 12 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.157449:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71a00, rc 0) 00000100:00100000:0.0:1787853644.157520:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+12:11622:x1874700136444544:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 2793us (3096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853644.157531:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 64 00000100:00100000:3.0:1787853644.165751:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853644.165864:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136444672 00000100:00100000:2.0:1787853644.165877:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136444672 00010000:00010000:2.0:1787853644.165935:0:5811:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b163a7d2/0xcf1365f7cb0557a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22f5 expref: 12 pid: 11669 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853644.165990:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 83 00000100:00100000:2.0:1787853644.166003:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+12:2365:x1874700136444672:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853644.166261:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853644.166302:0:5811:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b163a7d2/0xcf1365f7cb0557a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22f5 expref: 12 pid: 11669 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.166320:0:5811:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b163a7d2/0xcf1365f7cb0557a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22f5 expref: 12 pid: 11669 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.166350:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b163a7d2/0xcf1365f7cb0557a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22f5 expref: 12 pid: 11669 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.166371:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853644.166376:0:5811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853644.166386:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb0557ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22fc expref: 11 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.166399:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb0557ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22fc expref: 11 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.166448:0:5811:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb0557ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22fc expref: 11 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853644.166466:0:5811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3cd680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5811:1874700152154368:192.168.206.10@tcp:105: 00000100:00100000:2.0:1787853644.166754:0:5811:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d55600 going to sleep for 11 seconds 00000100:00100000:2.0:1787853644.171803:0:5811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3cd680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5811:1874700152154368:192.168.206.10@tcp:105: 00010000:00010000:2.0:1787853644.171929:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853644.172066:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+11:2365:x1874700136444672:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 6063us (6329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853644.172104:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 83 00000100:00100000:3.0:1787853644.187721:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853644.187885:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136444800 00000100:00100000:1.0:1787853644.187896:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136444800 00002000:00100000:1.0:1787853644.187960:0:6678:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff99277c3a4f00 x1874700136444800/t0(0) o4->0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp:65/0 lens 504/0 e 0 to 0 dl 1787853655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787853644.187974:0:6678:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99277c3a4f00 with x1874700136444800 ext(0->12) 00002000:00010000:1.0:1787853644.187980:0:6678:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99277c3a4f00 00000100:00100000:1.0:1787853644.188008:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:1.0:1787853644.188018:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+11:2364:x1874700136444800:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787853644.188611:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+13:2364:x1874700136444800:12345-192.168.206.10@tcp:4:lhsmtool_posix.0 Request processed in 590us (940us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1787853644.188623:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00002000:00100000:1.0:1787853644.188632:0:6678:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff99277c3a4f00 x1874700136444800/t4294967320(0) o4->0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp:65/0 lens 504/448 e 0 to 0 dl 1787853655 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787853644.188641:0:6678:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99277c3a4f00 with x1874700136444800 ext(0->12) 00002000:00010000:1.0:1787853644.188645:0:6678:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99277c3a4f00 00000100:00100000:3.0:1787853644.192394:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853644.192511:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136444928 00000100:00100000:2.0:1787853644.192524:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136444928 00000100:00100000:2.0:1787853644.192597:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 227 00000100:00100000:2.0:1787853644.192607:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+66:11622:x1874700136444928:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787853644.230868:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000001:00080000:2.0:1787853644.230945:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1787853644.230954:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:2.0:1787853644.230994:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1787853644.231019:0:5846:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff992766169cc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1787853644.231025:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99276d65b600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9927661690c0 00000020:00080000:2.0:1787853644.231029:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99276d65bc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99277c279800 00000020:00080000:2.0:1787853644.231388:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 6 committed batchid 5 00000020:00080000:2.0:1787853644.231614:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787853644.231728:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152154496:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787853644.231819:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853644.231909:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152154496 00000100:00100000:1.0:1787853644.231917:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152154496 00000100:00100000:1.0:1787853644.232005:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787853644.232015:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992775483c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1874700152154496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787853644.232060:0:6673:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1787853644.232102:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc0699b0/0xcf1365f7cb0557b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.232132:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009592ade5/0xcf1365f7cb055576 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd225b expref: 12 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.232143:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787853644.232148:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787853644.232154:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc0699b0/0xcf1365f7cb0557b4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.232188:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009592ade5/0xcf1365f7cb055576 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd225b expref: 12 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.232205:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009592ade5/0xcf1365f7cb055576 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd225b expref: 12 pid: 11669 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853644.232218:0:6673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6673:1874700152154752:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787853644.232287:0:6673:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d5c600 going to sleep for 11 seconds 00000100:00080000:1.0:1787853644.232302:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853644.232769:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152154624:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787853644.232807:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787853644.232903:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787853644.232925:0:5846:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9927463b3cc0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1787853644.232929:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff992745878f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9927463b3840 00000020:00080000:2.0:1787853644.232931:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff992745878e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99277c58d400 00000100:00100000:2.0:1787853644.233482:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152154880:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787853644.233519:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787853644.233661:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1787853644.233745:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787853644.235635:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853644.235755:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136445056 00000100:00100000:2.0:1787853644.235831:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136445056 00010000:00010000:2.0:1787853644.235876:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009592ade5/0xcf1365f7cb055576 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd225b expref: 13 pid: 11669 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853644.235918:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 84 00000100:00100000:2.0:1787853644.235928:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3cda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+13:2365:x1874700136445056:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853644.235944:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853644.235955:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009592ade5/0xcf1365f7cb055576 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd225b expref: 13 pid: 11669 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.235972:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009592ade5/0xcf1365f7cb055576 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd225b expref: 13 pid: 11669 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.236006:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787853644.236011:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787853644.236017:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bc0699b0/0xcf1365f7cb0557b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.236029:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc0699b0/0xcf1365f7cb0557b4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.236219:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009592ade5/0xcf1365f7cb055576 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd225b expref: 13 pid: 11669 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853644.236237:0:6673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6673:1874700152154752:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787853644.236263:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bc0699b0/0xcf1365f7cb0557b4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.236324:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853644.236379:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3cda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+12:2365:x1874700136445056:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 453us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853644.236388:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 84 00010000:00010000:0.0:1787853644.236467:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bc0699b0/0xcf1365f7cb0557b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.236742:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc0699b0/0xcf1365f7cb0557b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.236755:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc0699b0/0xcf1365f7cb0557b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.236822:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc0699b0/0xcf1365f7cb0557b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.236841:0:6673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787853644.237576:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152154624 00000100:00100000:3.0:1787853644.237585:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152154624 00000100:00100000:3.0:1787853644.237626:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152154880 00000100:00100000:3.0:1787853644.237629:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152154880 00000100:00100000:3.0:1787853644.237945:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787853644.237955:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1874700152154624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787853644.238582:0:6671:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787853644.238587:0:6671:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787853644 00002000:00010000:3.0:1787853644.238590:0:6671:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787853644.238591:0:6671:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787853644 -> 1787853644 00002000:00010000:3.0:1787853644.238593:0:6671:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:1.0:1787853644.238883:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853644.238895:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc0699b0/0xcf1365f7cb0557b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.238920:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196000 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:1.0:1787853644.238925:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc0699b0/0xcf1365f7cb0557b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.238937:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc0699b0/0xcf1365f7cb0557b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.238960:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc0699b0/0xcf1365f7cb0557b4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.238969:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc0699b0/0xcf1365f7cb0557b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.238993:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853644.238996:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853644.238997:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787853644.239007:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787853644.239128:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3300:x1874700152154624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1171us (6316us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787853644.239137:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787853644.239165:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787853644.239175:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3297:x1874700152154880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787853644.239203:0:6671:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1787853644.239238:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a907b4a, atime: 0x6a907b4a, ctime: 0x6a907b4a, blocks: 0x1 00010000:00010000:3.0:1787853644.239244:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006edf1f79/0xcf1365f7cb0557bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.239258:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=338s v=(0 0) 00010000:00010000:3.0:1787853644.239263:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853644.239271:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006edf1f79/0xcf1365f7cb0557bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.239286:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006edf1f79/0xcf1365f7cb0557bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.239294:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006edf1f79/0xcf1365f7cb0557bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.239313:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006edf1f79/0xcf1365f7cb0557bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.239332:0:6671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787853644.239548:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99277c3ced00/2, rc 0, transno 4294967321 00000100:00100000:2.0:1787853644.239556:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152154624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787853644.239730:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992775483c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3299:x1874700152154496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7716us (7910us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1787853644.239739:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:2.0:1787853644.239866:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99277c3cd680/2, rc 0, transno 4294967322 00000100:00100000:2.0:1787853644.239871:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152154496:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787853644.239943:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+20:11622:x1874700136444928:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 Request processed in 47336us (47566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853644.239954:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 227 00000100:00100000:3.0:1787853644.240386:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3297:x1874700152154880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1213us (6865us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787853644.240394:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:3.0:1787853644.240417:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853644.240424:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006edf1f79/0xcf1365f7cb0557bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.240436:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064c200 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:3.0:1787853644.240440:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006edf1f79/0xcf1365f7cb0557bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.240547:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006edf1f79/0xcf1365f7cb0557bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.240648:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006edf1f79/0xcf1365f7cb0557bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.240658:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006edf1f79/0xcf1365f7cb0557bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.240716:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853644.240729:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853644.240731:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787853644.240864:0:3297:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99277c3cc780/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787853644.240871:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3cc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152154880:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787853644.246139:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853644.246263:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136445184 00000100:00100000:1.0:1787853644.246276:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136445184 00000100:00100000:1.0:1787853644.246391:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:1.0:1787853644.246404:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+12:2364:x1874700136445184:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787853644.301751:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1787853644.301775:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:2.0:1787853644.301784:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:1.0:1787853644.303079:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2364:x1874700136445184:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 Request processed in 56665us (56942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853644.303116:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:0.0:1787853644.310474:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853644.310628:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136445440 00000100:00100000:1.0:1787853644.310642:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136445440 00000100:00100000:1.0:1787853644.310771:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 228 00000100:00100000:1.0:1787853644.310783:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+20:11622:x1874700136445440:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787853644.310856:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853644.310890:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb05579f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22ee expref: 20 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.310914:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff992743be3e00) 00010000:00010000:1.0:1787853644.310920:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853644.310959:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0557c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.310976:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0557c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.310987:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0557c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787853644.311302:0:5826:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071534a93 reply state 000000005376f750 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0557c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853644.311313:0:5826:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787853644.311817:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+21:11622:x1874700136445440:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 1033us (1354us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1787853644.311827:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 228 00010000:00010000:3.0:1787853644.313534:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0557c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.313555:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0557c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.313565:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0557c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.313572:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853644.313578:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0557c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.313587:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0557c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.313622:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff992743be3e00) 00010000:00010000:3.0:1787853644.313626:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853644.313765:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0557c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.313774:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb0557c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853644.314601:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853644.318620:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136445568 00000100:00100000:1.0:1787853644.319253:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136445568 00000100:00100000:1.0:1787853644.319337:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:1.0:1787853644.319349:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2364:x1874700136445568:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787853644.319992:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787853644.319999:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787853644 -> 1787853642 00002000:00010000:1.0:1787853644.320002:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787853642 00002000:00010000:1.0:1787853644.320004:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787853644 -> 1787853642 00002000:00010000:1.0:1787853644.320007:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787853644.320951:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2364:x1874700136445568:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 1589us (6344us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787853644.320968:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:2.0:1787853644.323758:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853644.324249:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136445824 00000100:00100000:1.0:1787853644.324261:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136445824 00000100:00100000:1.0:1787853644.324338:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 229 00000100:00100000:1.0:1787853644.324349:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+20:11622:x1874700136445824:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787853644.324445:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb0557c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.324467:0:7618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb055783 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22e0 expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.324478:0:7618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb0557c9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.324533:0:7618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb055783 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22e0 expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.324550:0:7618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb055783 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22e0 expref: 20 pid: 5824 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853644.324582:0:7618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7618:1874700152155008:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787853644.324728:0:7618:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d5c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853644.327718:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853644.328201:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136445952 00000100:00100000:0.0:1787853644.328213:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136445952 00010000:00010000:0.0:1787853644.328268:0:8433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb055783 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22e0 expref: 21 pid: 5824 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853644.328317:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00100000:0.0:1787853644.328328:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+21:2364:x1874700136445952:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853644.328346:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853644.328354:0:8433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb055783 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22e0 expref: 21 pid: 5824 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.328539:0:8433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb055783 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22e0 expref: 21 pid: 5824 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.328571:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff992743be3e00) 00010000:00010000:0.0:1787853644.328578:0:8433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb0557c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.328590:0:8433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb0557c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.328600:0:8433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb0557c9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.328623:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853644.328796:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+21:2364:x1874700136445952:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 468us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853644.328881:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 85 00010000:00010000:1.0:1787853644.329366:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb055783 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22e0 expref: 20 pid: 5824 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853644.329397:0:7618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7618:1874700152155008:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787853644.329425:0:7618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb0557c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.329436:0:7618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb0557c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.329442:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb0557c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.329475:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb0557c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.329482:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb0557c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.329490:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb0557c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.329496:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853644.329501:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb0557c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.329542:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb0557c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.329556:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff992743be3e00) 00010000:00010000:1.0:1787853644.329559:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787853644.329563:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb0557c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.329570:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197200/0xcf1365f7cb0557c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853644.329636:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:11622:x1874700136445824:12345-192.168.206.10@tcp:55:lhsmtool_posix.0 Request processed in 5288us (5893us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787853644.329841:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 229 00000100:00100000:2.0:1787853644.339838:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853644.343243:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136446080 00000100:00100000:1.0:1787853644.343262:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136446080 00000100:00100000:2.0:1787853644.343437:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 70 00000100:00100000:2.0:1787853644.343447:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2363:x1874700136446080:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787853644.343502:0:11669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb0557d0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.343538:0:11669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb0557ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22fc expref: 8 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.343548:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853644.343553:0:11669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787853644.343558:0:11669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb0557d0 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.343637:0:11669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb0557ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22fc expref: 8 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.343653:0:11669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb0557ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22fc expref: 8 pid: 6671 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853644.343669:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748340b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11669:1874700152155136:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787853644.344004:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d55e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787853644.350344:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853644.350449:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136446208 00000100:00100000:0.0:1787853644.350461:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136446208 00010000:00010000:0.0:1787853644.350515:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb0557ad lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22fc expref: 9 pid: 6671 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853644.350571:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:0.0:1787853644.350583:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:2365:x1874700136446208:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853644.350604:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853644.350635:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb0557ad lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22fc expref: 9 pid: 6671 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.350717:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb0557ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22fc expref: 9 pid: 6671 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.350751:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787853644.350756:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787853644.350763:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb0557d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.350910:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb0557d0 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.350940:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853644.351005:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+9:2365:x1874700136446208:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 423us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853644.351014:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 86 00010000:00010000:2.0:1787853644.351903:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb0557ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22fc expref: 8 pid: 6671 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853644.351925:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748340b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11669:1874700152155136:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787853644.351954:0:11669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb0557d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.351967:0:11669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb0557d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.351975:0:11669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb0557d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.352015:0:11669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb0557d0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.352366:0:11669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb0557d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.352376:0:11669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb0557d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.352383:0:11669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70c00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853644.352388:0:11669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb0557d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.352398:0:11669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb0557d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.352417:0:11669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb0557d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.352426:0:11669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb0557d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853644.352522:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2363:x1874700136446080:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 Request processed in 9073us (12697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853644.352532:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 70 00000100:00100000:3.0:1787853644.363000:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853644.370587:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136446464 00000100:00100000:2.0:1787853644.370608:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136446464 00000100:00100000:2.0:1787853644.372012:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 230 00000100:00100000:2.0:1787853644.372203:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:11622:x1874700136446464:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787853644.372311:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0557d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.372333:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0557d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.372348:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0557d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.372623:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0557de lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.372636:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055791 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22e7 expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.373774:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0557de lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.373829:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055791 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22e7 expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.373848:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055791 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22e7 expref: 20 pid: 5824 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853644.373866:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748340b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5825:1874700152155264:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787853644.374109:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d55e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787853644.383470:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853644.383741:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136446592 00000100:00100000:0.0:1787853644.383752:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136446592 00010000:00010000:0.0:1787853644.383916:0:8433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055791 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22e7 expref: 21 pid: 5824 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853644.383970:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 87 00000100:00100000:0.0:1787853644.383981:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992766150050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+21:2364:x1874700136446592:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853644.384008:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853644.384016:0:8433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055791 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22e7 expref: 21 pid: 5824 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.384069:0:8433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055791 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22e7 expref: 21 pid: 5824 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.384099:0:8433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff992743be3e00) 00010000:00010000:0.0:1787853644.384106:0:8433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0557de lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.384117:0:8433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0557de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.384125:0:8433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0557de lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.384207:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853644.384285:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992766150050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+21:2364:x1874700136446592:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 306us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853644.384294:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 87 00010000:00010000:2.0:1787853644.384761:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70e00/0xcf1365f7cb055791 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22e7 expref: 20 pid: 5824 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853644.384796:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748340b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5825:1874700152155264:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787853644.384820:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0557de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.384831:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0557de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.384838:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0557de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787853644.385092:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1787853644.385259:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1787853644.385307:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1787853644.385408:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748340b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5825:1874700152155392:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787853644.385473:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853644.385511:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d55480 going to sleep for 11 seconds 00000100:00100000:0.0:1787853644.385870:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152155392 00000100:00100000:0.0:1787853644.385879:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152155392 00000100:00100000:0.0:1787853644.385934:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787853644.385944:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748342580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1874700152155392:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787853644.386030:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748342580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1874700152155392:12345-0@lo:1000:mdt00_001.0 Request processed in 88us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853644.386038:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787853644.386542:0:5825:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1787853644.386549:0:5825:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:2.0:1787853644.386573:0:5825:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99277c3ced00, transno 4294967321 00000004:00080000:2.0:1787853644.386581:0:5825:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99277c3cd680, transno 4294967322 00000100:00100000:2.0:1787853644.386589:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748340b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5825:1874700152155392:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787853644.387434:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1787853644.387521:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748340b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5825:1874700152155520:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787853644.387578:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853644.387935:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152155520 00000100:00100000:1.0:1787853644.387945:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152155520 00000100:00100000:1.0:1787853644.387995:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787853644.388004:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5825:x1874700152155520:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787853644.388253:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5825:x1874700152155520:12345-0@lo:1000:mdt00_001.0 Request processed in 249us (674us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1787853644.388262:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787853644.388503:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d55e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787853644.388540:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748340b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5825:1874700152155520:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787853644.388759:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0557de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.388770:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0557de lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.388778:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0557de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.388785:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71a00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853644.388789:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0557de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.388798:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0557de lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.388817:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff992743be3e00) 00010000:00010000:2.0:1787853644.388821:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787853644.388826:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0557de lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.388833:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb0557de lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.388870:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055721 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.388876:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055721 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.388882:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055721 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.388899:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a9800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853644.388902:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055721 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.388909:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055721 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.388918:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:2.0:1787853644.388921:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787853644.388928:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055728 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22cb expref: 23 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.388940:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055728 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22cb expref: 23 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.388949:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055728 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22cb expref: 23 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.388982:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055728 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22cb expref: 23 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853644.388997:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927483430c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5825:1874700152155648:192.168.206.10@tcp:105: 00000100:00100000:2.0:1787853644.389967:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d55e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787853644.396360:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853644.396449:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136446720 00000100:00100000:3.0:1787853644.396460:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136446720 00000100:00100000:3.0:1787853644.396528:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:3.0:1787853644.396539:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+24:11621:x1874700136446720:12345-192.168.206.10@tcp:49:lfs.0 00000100:00100000:3.0:1787853644.396848:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+24:11621:x1874700136446720:12345-192.168.206.10@tcp:49:lfs.0 Request processed in 310us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853644.396857:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 61 00000100:00100000:2.0:1787853644.397400:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927483430c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5825:1874700152155648:192.168.206.10@tcp:105: 00010000:00010000:2.0:1787853644.397437:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055721 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.397463:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9800/0xcf1365f7cb055721 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.397503:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0557e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.397521:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0557e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.397535:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0557e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.397545:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0557e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.397552:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0557e5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.397559:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0557e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.397566:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853644.397570:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0557e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.397578:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0557e5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.397590:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:2.0:1787853644.397594:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853644.397598:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0557e5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.397805:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb0557e5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.397818:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0557d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.397824:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0557d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.397830:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0557d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.397835:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853644.397838:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0557d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.397843:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0557d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.397852:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:2.0:1787853644.397854:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787853644.397857:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0557d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.397862:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70c00/0xcf1365f7cb0557d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853644.398204:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+23:11622:x1874700136446464:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 26159us (35216us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787853644.398216:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 230 00000020:00080000:2.0:1787853644.398231:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787853644.399149:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853644.400261:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136446976 00000100:00100000:2.0:1787853644.400277:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136446976 00000100:00100000:2.0:1787853644.400358:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 231 00000100:00100000:2.0:1787853644.400368:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+23:11621:x1874700136446976:12345-192.168.206.10@tcp:58:lfs.0 00000040:00080000:2.0:1787853644.400925:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1787853644.401058:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+23:11621:x1874700136446976:12345-192.168.206.10@tcp:58:lfs.0 Request processed in 689us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853644.401067:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 231 00000100:00100000:0.0:1787853644.403005:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853644.403165:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136447232 00000100:00100000:3.0:1787853644.403177:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136447232 00000100:00100000:3.0:1787853644.403243:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 62 00000100:00100000:3.0:1787853644.403254:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274f705050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+23:11622:x1874700136447232:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000040:00080000:1.0:1787853644.404913:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787853644.404921:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787853644.404968:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787853644.404976:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787853644.405252:0:11666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78cf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874700152155776:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787853644.405376:0:11666:0:(client.c:2715:ptlrpc_set_wait()) set ffff992747d5c600 going to sleep for 11 seconds 00000004:00080000:3.0:1787853644.405923:0:5828:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787853644.407579:0:5828:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1787853644.408543:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0557ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.408569:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0557ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.408584:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0557ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.408594:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0557ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.409450:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0557ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.409462:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0557ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853644.409494:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787853644.410190:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274f705050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+26:11622:x1874700136447232:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 6929us (7185us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1787853644.410226:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 62 00000020:00080000:3.0:1787853644.410235:0:5828:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787853644.410445:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853644.410456:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0557ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.410466:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064d000 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:1.0:1787853644.410471:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0557ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.410481:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0557ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.410503:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff992750252600) 00010000:00010000:1.0:1787853644.410507:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787853644.410512:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0557ec lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.410520:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d000/0xcf1365f7cb0557ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5828 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.410544:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853644.410546:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853644.410548:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853644.410836:0:11666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78cf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1874700152155776:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787853644.426825:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853644.427013:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136447360 00000100:00100000:1.0:1787853644.427026:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136447360 00000100:00100000:1.0:1787853644.427108:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 232 00000100:00100000:1.0:1787853644.427120:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+25:11623:x1874700136447360:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787853644.427166:0:5826:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787853644.427300:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+25:11623:x1874700136447360:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 181us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853644.427324:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 232 00000100:00100000:2.0:1787853644.452659:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853644.453014:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136447616 00000100:00100000:0.0:1787853644.453053:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136447616 00000100:00100000:0.0:1787853644.453129:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 233 00000100:00100000:0.0:1787853644.453140:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748343840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+25:11623:x1874700136447616:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787853644.453168:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853644.453193:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb0557f3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2303 expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.453314:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0557fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.453331:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0557fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.453344:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0557fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787853644.453365:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787853644.453627:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb0557f3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2303 expref: 28 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.453652:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0557fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2303 expref: 27 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.453662:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:0.0:1787853644.453665:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787853644.453669:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a8600, rc 0) 00000100:00100000:0.0:1787853644.453912:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748343840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+27:11623:x1874700136447616:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 773us (1266us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787853644.453921:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 233 00000100:00100000:3.0:1787853644.464338:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853644.464485:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136447872 00000100:00100000:1.0:1787853644.464496:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136447872 00000100:00100000:1.0:1787853644.464559:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 234 00000100:00100000:1.0:1787853644.464570:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+27:11623:x1874700136447872:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787853644.464865:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055808 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.464887:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055808 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.464901:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055808 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.465192:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055808 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.465201:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055808 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.465209:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055808 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.465215:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853644.465220:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055808 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.465229:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055808 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.465264:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:1.0:1787853644.465267:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787853644.465273:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055808 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.465280:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055808 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853644.465528:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+28:11623:x1874700136447872:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 958us (1199us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787853644.465537:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 234 00000040:00080000:3.0:1787853644.465990:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787853644.465995:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787853644.466762:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787853644.466774:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787853644.476948:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853644.480253:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136448000 00000100:00100000:0.0:1787853644.480274:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136448000 00000100:00100000:0.0:1787853644.480457:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 235 00000100:00100000:0.0:1787853644.480469:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748341680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+28:11625:x1874700136448000:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:0.0:1787853644.480499:0:7618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853644.480525:0:7618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb05580f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd230a expref: -99 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.480649:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055816 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.480667:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055816 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.482205:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055816 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.482244:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb05581d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.482256:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb05581d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.482263:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb05581d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.482653:0:7618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055824 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.482689:0:7618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055713 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22c4 expref: 29 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.482972:0:7618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055824 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853644.483401:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853644.483460:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136448256 00000100:00100000:1.0:1787853644.483469:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136448256 00000100:00100000:1.0:1787853644.483527:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00100000:1.0:1787853644.483539:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+30:11623:x1874700136448256:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00010000:00010000:0.0:1787853644.483823:0:7618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055713 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22c4 expref: 30 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853644.483842:0:7618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055713 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22c4 expref: 30 pid: 5826 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853644.483860:0:7618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dadd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7618:1874700152155904:192.168.206.10@tcp:104: 00000100:00100000:0.0:1787853644.483964:0:7618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927463b3000 going to sleep for 11 seconds 00000100:00100000:1.0:1787853644.484217:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+31:11623:x1874700136448256:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 679us (818us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787853644.484227:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 63 00000100:00100000:0.0:1787853644.488221:0:7618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dadd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7618:1874700152155904:192.168.206.10@tcp:104: 00010000:00010000:0.0:1787853644.488262:0:7618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055824 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853644.490213:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853644.490901:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136448512 00000100:00100000:0.0:1787853644.490915:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136448512 00000100:00100000:0.0:1787853644.490988:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 64 00000100:00100000:0.0:1787853644.490999:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+31:5599:x1874700136448512:12345-192.168.206.10@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787853644.492889:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+32:5599:x1874700136448512:12345-192.168.206.10@tcp:35:ldlm_bl.0 Request processed in 1879us (2675us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787853644.492905:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 64 00000100:00100000:1.0:1787853644.496795:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853644.497167:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136448640 00000100:00100000:2.0:1787853644.497182:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136448640 00010000:00010000:2.0:1787853644.497243:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055713 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22c4 expref: 32 pid: 5826 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853644.497290:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 88 00000100:00100000:2.0:1787853644.497301:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483461c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+32:2365:x1874700136448640:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853644.497320:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853644.497327:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055713 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22c4 expref: 32 pid: 5826 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.497342:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055713 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22c4 expref: 32 pid: 5826 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.497370:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71c00/0xcf1365f7cb055713 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22c4 expref: 32 pid: 5826 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.497409:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:2.0:1787853644.497416:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055824 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.497427:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.497436:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055824 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853644.497475:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853644.497552:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483461c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+31:2365:x1874700136448640:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 252us (1920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853644.497560:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 88 00010000:00010000:1.0:1787853644.499062:0:7618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.499080:0:7618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853644.499139:0:7618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787853644.499160:0:7618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853644.499187:0:7618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.499204:0:7618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.499215:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055816 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.499223:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055816 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.499231:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055816 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.499238:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a9400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853644.499243:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055816 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.499251:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055816 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.499269:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:1.0:1787853644.499273:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853644.499277:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055816 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.499285:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9400/0xcf1365f7cb055816 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.499301:0:7618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb05581d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.499318:0:7618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb05581d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.499324:0:7618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb05581d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.499329:0:7618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8a00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853644.499332:0:7618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb05581d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.499339:0:7618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb05581d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.499348:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff992761dc9b00) 00010000:00010000:1.0:1787853644.499350:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853644.499353:0:7618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb05581d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.499360:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8a00/0xcf1365f7cb05581d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.499409:0:7618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb05580f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd230a expref: 31 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.499424:0:7618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055824 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd230a expref: 30 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853644.499432:0:7618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:1.0:1787853644.499434:0:7618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787853644.499442:0:7618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a8000, rc 0) 00000100:00100000:1.0:1787853644.499515:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748341680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+30:11625:x1874700136448000:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 19047us (22577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853644.499524:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 235 00000100:00100000:3.0:1787853644.614306:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853644.614336:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152156032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853644.614435:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853644.614533:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152156032 00000100:00100000:3.0:1787853644.614542:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152156032 00000100:00100000:3.0:1787853644.614601:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787853644.614611:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3297:x1874700152156032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787853644.614639:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853644.614710:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3297:x1874700152156032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853644.614718:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787853644.614778:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152156032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853644.617131:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748342d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152156160:0@lo:400:kworker.0 00000100:00100000:3.0:1787853644.617221:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853644.617360:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152156160 00000100:00100000:0.0:1787853644.617370:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152156160 00000100:00100000:0.0:1787853644.617430:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787853644.617441:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152156160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853644.626527:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748341e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874700152156288:0@lo:400:kworker.0 00000100:00100000:2.0:1787853644.627498:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748340780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152156416:0@lo:400:kworker.0 00000100:00100000:2.0:1787853644.627569:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853644.627613:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853644.627618:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748342940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1874700152156544:0@lo:400:kworker.0 00000100:00100000:2.0:1787853644.627637:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853644.627667:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152156416 00000100:00100000:2.0:1787853644.627693:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152156416 00000100:00100000:2.0:1787853644.627749:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152156544 00000100:00100000:2.0:1787853644.627752:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152156544 00000100:00100000:2.0:1787853644.627772:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787853644.627781:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748341a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152156416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853644.627833:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748341a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152156416:12345-0@lo:400:kworker.0 Request processed in 53us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853644.627871:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787853644.627891:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787853644.627897:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874700152156544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853644.627925:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874700152156544:12345-0@lo:400:kworker.0 Request processed in 29us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853644.627931:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1787853644.627947:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853644.627995:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748342940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1874700152156544:0@lo:400:kworker.0 00000100:00100000:2.0:1787853644.628006:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748340780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152156416:0@lo:400:kworker.0 00000100:00100000:1.0:1787853644.629070:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853644.629577:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152156288 00000100:00100000:2.0:1787853644.629585:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152156288 00000100:00100000:2.0:1787853644.629642:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787853644.629651:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874700152156288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853644.629735:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874700152156288:12345-0@lo:400:kworker.0 Request processed in 85us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853644.629742:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787853644.629783:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748341e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874700152156288:0@lo:400:kworker.0 00000100:00100000:0.0:1787853644.630361:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3299:x1874700152156160:12345-0@lo:400:kworker.0 Request processed in 12908us (13127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853644.630374:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787853644.648163:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748342d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152156160:0@lo:400:kworker.0 00010000:00010000:3.0:1787853644.682838:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787853645.413883:0:12594:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787853645.413898:0:12594:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787853645.413971:0:12594:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787853645.413979:0:12594:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787853645.651844:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853645.651895:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136448896 00000100:00100000:2.0:1787853645.651907:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136448896 00000100:00100000:2.0:1787853645.651985:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 236 00000100:00100000:2.0:1787853645.652011:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748340780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+30:11648:x1874700136448896:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787853645.652053:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853645.652080:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb05582b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2311 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853645.652212:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb055832 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853645.652231:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb055832 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853645.652248:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb055832 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853645.652262:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787853645.652422:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f70000/0xcf1365f7cb05582b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2311 expref: 33 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853645.652442:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb055832 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2311 expref: 32 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853645.652452:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:2.0:1787853645.652455:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787853645.652459:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71a00, rc 0) 00000100:00100000:2.0:1787853645.653147:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748340780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+32:11648:x1874700136448896:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1133us (1309us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787853645.653157:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 236 00000100:00080000:2.0:1787853645.653198:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853645.660717:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853645.661312:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136449024 00000100:00100000:0.0:1787853645.661325:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136449024 00000100:00100000:0.0:1787853645.661389:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 237 00000100:00100000:0.0:1787853645.661401:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+32:11648:x1874700136449024:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:0.0:1787853645.661487:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055840 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853645.661519:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055840 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853645.661540:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055840 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853645.661574:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055840 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853645.661581:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055840 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853645.661589:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055840 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853645.661595:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853645.661599:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055840 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853645.661705:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055840 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853645.661719:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:0.0:1787853645.661722:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787853645.661727:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055840 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853645.661734:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8800/0xcf1365f7cb055840 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853645.661833:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+32:11648:x1874700136449024:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 433us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853645.661841:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 237 00010000:00010000:1.0:1787853645.701967:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853645.818824:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853645.818992:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136449152 00000100:00100000:3.0:1787853645.819006:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136449152 00000100:00100000:3.0:1787853645.819098:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00100000:3.0:1787853645.819111:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748342940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2362:x1874700136449152:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:3.0:1787853645.819137:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853645.819165:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006edf1f79/0xcf1365f7cb055847 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2318 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787853645.819203:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a907b4a, atime: 0x6a907b4a, ctime: 0x6a907b4a, blocks: 0xb 00010000:00010000:3.0:1787853645.819232:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1787853645.819237:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853645.819250:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006edf1f79/0xcf1365f7cb055847 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2318 expref: 8 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853645.819274:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006edf1f79/0xcf1365f7cb055847 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2318 expref: 8 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853645.819292:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99275064c200, rc 0) 00000100:00100000:3.0:1787853645.819371:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748342940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2362:x1874700136449152:12345-192.168.206.10@tcp:101:cat.0 Request processed in 262us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853645.819379:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 71 00000100:00100000:0.0:1787853645.827534:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853645.827714:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136449280 00000100:00100000:1.0:1787853645.827726:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136449280 00002000:00100000:1.0:1787853645.827803:0:6677:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff99276dadd2c0 x1874700136449280/t0(0) o3->0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp:66/0 lens 488/0 e 0 to 0 dl 1787853656 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787853645.827817:0:6677:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99276dadd2c0 with x1874700136449280 ext(0->4095) 00002000:00010000:1.0:1787853645.827824:0:6677:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99276dadd2c0 00000100:00100000:1.0:1787853645.827872:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:1.0:1787853645.827883:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2363:x1874700136449280:12345-192.168.206.10@tcp:3:cat.0 00000100:00100000:1.0:1787853645.828191:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2363:x1874700136449280:12345-192.168.206.10@tcp:3:cat.0 Request processed in 308us (672us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787853645.828201:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00002000:00100000:1.0:1787853645.828209:0:6677:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff99276dadd2c0 x1874700136449280/t0(0) o3->0d6ecd6d-a011-4e2a-a67c-6551aba162fe@192.168.206.10@tcp:66/0 lens 488/4536 e 0 to 0 dl 1787853656 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787853645.828218:0:6677:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff99276dadd2c0 with x1874700136449280 ext(0->4095) 00002000:00010000:1.0:1787853645.828223:0:6677:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99276dadd2c0 00010000:00010000:3.0:1787853646.730154:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787853647.256693:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1787853647.256966:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:3.0:1787853647.301010:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853647.301082:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853647.301123:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136449792 00000100:00100000:3.0:1787853647.301136:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136449792 00000100:00100000:0.0:1787853647.301367:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136449536 00000100:00100000:0.0:1787853647.301373:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136449536 00000100:00100000:0.0:1787853647.301429:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 152 00000100:00100000:0.0:1787853647.301441:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+32:2363:x1874700136449536:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853647.302204:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+32:2363:x1874700136449536:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 761us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853647.302223:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 152 00000100:00100000:0.0:1787853647.302299:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853647.303315:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 72 00000100:00100000:3.0:1787853647.303346:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2363:x1874700136449792:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787853647.303415:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2363:x1874700136449792:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 78us (2331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853647.303422:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 72 00000100:00080000:3.0:1787853647.303457:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787853647.303464:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787853647.303485:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136449408 00000100:00100000:3.0:1787853647.303494:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136449408 00000100:00100000:3.0:1787853647.303537:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 295 00000100:00100000:3.0:1787853647.303545:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2363:x1874700136449408:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787853647.303573:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2363:x1874700136449408:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 29us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853647.303579:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 295 00000100:00100000:2.0:1787853647.307645:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853647.307732:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853647.313786:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136449664 00000100:00100000:3.0:1787853647.313808:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136449664 00000100:00100000:3.0:1787853647.313904:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 73 00000100:00100000:3.0:1787853647.313917:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748343c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2363:x1874700136449664:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787853647.314056:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748343c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+8:2363:x1874700136449664:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 142us (6427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853647.314065:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 73 00000100:00100000:0.0:1787853647.315374:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136449920 00000100:00100000:0.0:1787853647.315385:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136449920 00000100:00100000:0.0:1787853647.315609:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 153 00000100:00100000:0.0:1787853647.315621:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2363:x1874700136449920:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:0.0:1787853647.315750:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2363:x1874700136449920:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 121us (8006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853647.315759:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 153 00000100:00080000:1.0:1787853647.316080:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853647.316087:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853647.686201:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787853647.686232:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748340f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152156672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853647.686327:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853647.686726:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152156672 00000100:00100000:0.0:1787853647.686736:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152156672 00000100:00100000:0.0:1787853647.686893:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787853647.686904:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748345680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874700152156672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787853647.686949:0:6674:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787853647.687119:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787853647.687414:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748340f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152156672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853647.687512:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748345680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874700152156672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 609us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853647.687521:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:1.0:1787853647.750721:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853648.777418:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787853649.306464:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:1.0:1787853649.306840:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1787853649.306862:0:5846:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff992747d55480 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787853649.306868:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff992747acb200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff992747d55600 00000020:00080000:1.0:1787853649.306871:0:5846:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff992747acb800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99277523fc00 00000020:00080000:1.0:1787853649.306896:0:5846:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1787853649.306901:0:5846:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 6 batchid updated 00000020:00080000:2.0:1787853649.306952:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787853649.307294:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1787853649.733919:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152156800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853649.734026:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853649.734085:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152157312:0@lo:400:kworker.0 00000100:00100000:3.0:1787853649.734130:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853649.734168:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787853649.734176:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1874700152157184:0@lo:400:kworker.0 00000100:00100000:3.0:1787853649.734204:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853649.734252:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152156928:0@lo:400:kworker.0 00000100:00100000:3.0:1787853649.734287:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853649.734312:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1874700152157440:0@lo:400:kworker.0 00000100:00100000:3.0:1787853649.734333:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853649.734356:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787853649.734361:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152157056:0@lo:400:kworker.0 00000100:00100000:3.0:1787853649.734380:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853649.734395:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276de192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152157568:0@lo:400:kworker.0 00000100:00100000:3.0:1787853649.734410:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853649.734440:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152156800 00000100:00100000:3.0:1787853649.734448:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152156800 00000100:00100000:3.0:1787853649.734526:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787853649.734537:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daa1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152156800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787853649.734591:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853649.734633:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152157184 00000100:00100000:2.0:1787853649.734638:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152157184 00000100:00100000:3.0:1787853649.734641:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daa1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152156800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853649.734648:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787853649.734697:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152157440 00000100:00100000:2.0:1787853649.734701:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152157440 00000100:00100000:2.0:1787853649.734714:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152157056 00000100:00100000:2.0:1787853649.734717:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152157056 00000100:00100000:2.0:1787853649.734727:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787853649.734733:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874700152157184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853649.734769:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874700152157184:12345-0@lo:400:kworker.0 Request processed in 37us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853649.734775:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787853649.734787:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787853649.734792:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874700152157440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853649.734817:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874700152157440:12345-0@lo:400:kworker.0 Request processed in 25us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853649.734822:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787853649.734831:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787853649.734835:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152157056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853649.734857:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152157056:12345-0@lo:400:kworker.0 Request processed in 21us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853649.734861:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787853649.735742:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152156928 00000100:00100000:1.0:1787853649.735752:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152156928 00000100:00100000:1.0:1787853649.735790:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787853649.735799:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152156928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853649.735949:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152156928:12345-0@lo:400:kworker.0 Request processed in 151us (1660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853649.735956:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:1.0:1787853649.736035:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853649.736042:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787853649.736055:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152157312 00000100:00100000:1.0:1787853649.736058:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152157312 00000100:00100000:1.0:1787853649.736091:0:11669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152157568 00000100:00100000:1.0:1787853649.736095:0:11669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152157568 00000100:00100000:1.0:1787853649.736116:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787853649.736122:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1874700152157312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853649.736157:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1874700152157312:12345-0@lo:400:kworker.0 Request processed in 35us (2026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853649.736171:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787853649.736183:0:11669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787853649.736188:0:11669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152157568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853649.736220:0:11669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152157568:12345-0@lo:400:kworker.0 Request processed in 32us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853649.736991:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152157056:0@lo:400:kworker.0 00000100:00100000:3.0:1787853649.737008:0:3297:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787853649.737024:0:3297:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1787853649.737043:0:3297:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99277c3cc780, transno 4294967310 00000100:00100000:3.0:1787853649.737056:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276de192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152157568:0@lo:400:kworker.0 00000100:00100000:3.0:1787853649.737081:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152156928:0@lo:400:kworker.0 00000100:00100000:3.0:1787853649.737094:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1874700152157440:0@lo:400:kworker.0 00000100:00100000:3.0:1787853649.737795:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1874700152157184:0@lo:400:kworker.0 00000100:00100000:3.0:1787853649.737814:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152156800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853649.737826:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152157312:0@lo:400:kworker.0 00000100:00100000:1.0:1787853649.740334:0:11669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787853649.740416:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787853649.797739:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787853649.808718:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1787853649.808742:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000040:00080000:3.0:1787853650.641130:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787853650.641144:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787853650.642080:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1787853650.642093:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787853650.812750:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853650.814042:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136450048 00000100:00100000:0.0:1787853650.814060:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136450048 00000100:00100000:0.0:1787853650.814167:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 238 00000100:00100000:0.0:1787853650.814181:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:11302:x1874700136450048:12345-192.168.206.10@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787853650.814324:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:11302:x1874700136450048:12345-192.168.206.10@tcp:60:lhsmtool_posix.0 Request processed in 148us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853650.814333:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 238 00000100:00080000:1.0:1787853650.814430:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787853650.822507:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853650.825268:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853650.825414:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136450304 00000100:00100000:0.0:1787853650.825429:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136450304 00000100:00100000:0.0:1787853650.825502:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:0.0:1787853650.825514:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:11302:x1874700136450304:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787853650.826192:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+20:11302:x1874700136450304:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 676us (936us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787853650.826214:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 65 00000100:00100000:3.0:1787853651.156576:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853651.156713:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136450432 00000100:00100000:1.0:1787853651.156730:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136450432 00000100:00100000:1.0:1787853651.156846:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 239 00000100:00100000:1.0:1787853651.156857:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:12102:x1874700136450432:12345-192.168.206.10@tcp:101:lsof.0 00010000:00010000:1.0:1787853651.156883:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853651.156909:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb05584e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd231f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787853651.156944:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787853651.156990:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb055855 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853651.157020:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb055855 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853651.157044:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb055855 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853651.157333:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787853651.157338:0:5825:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853651.157454:0:5825:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb055855 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853651.157485:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb05584e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd231f expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853651.157504:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb055855 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd231f expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853651.157513:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992761dc9f00) 00010000:00010000:1.0:1787853651.157517:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787853651.157521:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196e00, rc 0) 00000100:00100000:1.0:1787853651.157605:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:12102:x1874700136450432:12345-192.168.206.10@tcp:101:lsof.0 Request processed in 750us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853651.157613:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 239 00010000:00010000:0.0:1787853651.845909:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853652.419595:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853652.419646:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853652.419764:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853652.419789:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853652.419838:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853652.419875:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136450816 00000100:00100000:2.0:1787853652.419886:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136450816 00000100:00100000:2.0:1787853652.419953:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136450944 00000100:00100000:2.0:1787853652.419956:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136450944 00000100:00100000:2.0:1787853652.419979:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:2.0:1787853652.419989:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277512f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2365:x1874700136450816:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853652.420115:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277512f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2365:x1874700136450816:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 127us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853652.420124:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:2.0:1787853652.420288:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:2.0:1787853652.420296:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748342d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136450944:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853652.420325:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748342d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2365:x1874700136450944:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 30us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853652.420332:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:2.0:1787853652.420355:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136451072 00000100:00100000:2.0:1787853652.420359:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136451072 00000100:00100000:2.0:1787853652.420389:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 157 00000100:00100000:2.0:1787853652.420396:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748340f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:2365:x1874700136451072:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853652.420442:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748340f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:2365:x1874700136451072:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 46us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853652.420448:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 157 00000100:00100000:2.0:1787853652.420459:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136450688 00000100:00100000:2.0:1787853652.420463:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136450688 00000100:00100000:2.0:1787853652.420486:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 158 00000100:00100000:2.0:1787853652.420492:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748341e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+20:2365:x1874700136450688:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853652.420524:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748341e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+20:2365:x1874700136450688:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 32us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853652.420530:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 158 00000100:00080000:2.0:1787853652.420547:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787853652.420552:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787853652.420555:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853652.421159:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136450560 00000100:00100000:3.0:1787853652.421167:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136450560 00000100:00100000:3.0:1787853652.421217:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 297 00000100:00100000:3.0:1787853652.421225:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2365:x1874700136450560:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787853652.421281:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2365:x1874700136450560:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 57us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853652.421289:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 297 00000100:00100000:0.0:1787853652.808021:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853652.808055:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748342940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152157696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853652.808156:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853652.808335:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152157696 00000100:00100000:1.0:1787853652.808348:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152157696 00000100:00100000:1.0:1787853652.808438:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787853652.808449:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dade1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152157696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787853652.808496:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853652.808558:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dade1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152157696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853652.808566:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787853652.808612:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787853652.808618:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787853652.808652:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748342940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152157696:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787853652.810265:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787853652.870836:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853653.895649:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787853654.375220:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1787853654.375236:0:5846:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1787853654.375323:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787853654.375334:0:5858:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:02000400:2.0:1787853654.685633:0:12799:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 14:00:53 (1787853653) 00000100:00100000:2.0:1787853654.855855:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748342940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152157824:0@lo:400:kworker.0 00000100:00100000:2.0:1787853654.855953:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853654.856027:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c24d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152158336:0@lo:400:kworker.0 00000100:00100000:2.0:1787853654.856138:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853654.856174:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787853654.856181:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152158208:0@lo:400:kworker.0 00000100:00100000:2.0:1787853654.856215:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853654.856420:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152157824 00000100:00100000:1.0:1787853654.856429:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152157824 00000100:00100000:1.0:1787853654.856496:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787853654.856507:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3300:x1874700152157824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853654.856566:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3300:x1874700152157824:12345-0@lo:400:kworker.0 Request processed in 62us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853654.856575:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1787853654.856885:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748340b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152157952:0@lo:400:kworker.0 00000100:00100000:2.0:1787853654.856917:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853654.856943:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276f6f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152158464:0@lo:400:kworker.0 00000100:00100000:2.0:1787853654.856980:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853654.857133:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787853654.857142:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927500d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152158080:0@lo:400:kworker.0 00000100:00100000:2.0:1787853654.857170:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853654.857665:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748345e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152158592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853654.857784:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853654.857894:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152158208 00000100:00100000:1.0:1787853654.857902:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152158208 00000100:00100000:1.0:1787853654.857956:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152158464 00000100:00100000:1.0:1787853654.857960:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152158464 00000100:00100000:1.0:1787853654.858123:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787853654.858134:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152158208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853654.858203:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152158208:12345-0@lo:400:kworker.0 Request processed in 70us (1987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853654.858211:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787853654.858213:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152158336 00000100:00100000:3.0:1787853654.858220:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152158336 00000100:00100000:1.0:1787853654.858232:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787853654.858240:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152158464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853654.858276:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152158464:12345-0@lo:400:kworker.0 Request processed in 38us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853654.858282:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787853654.858304:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152157952 00000100:00100000:1.0:1787853654.858308:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152157952 00000100:00100000:1.0:1787853654.858333:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152158080 00000100:00100000:1.0:1787853654.858337:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152158080 00000100:00100000:1.0:1787853654.858353:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787853654.858359:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152157952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853654.858405:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152157952:12345-0@lo:400:kworker.0 Request processed in 46us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853654.858412:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787853654.858424:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787853654.858431:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152158080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853654.858458:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152158080:12345-0@lo:400:kworker.0 Request processed in 28us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853654.858464:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787853654.858484:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152158592 00000100:00100000:1.0:1787853654.858487:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152158592 00000100:00100000:1.0:1787853654.858517:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787853654.858524:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152158592:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853654.858528:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787853654.858541:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276f6f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152158336:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1787853654.858563:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853654.858589:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276f6f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152158336:12345-0@lo:400:kworker.0 Request processed in 51us (2451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853654.858605:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787853654.858786:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152158208:0@lo:400:kworker.0 00000100:00100000:2.0:1787853654.858802:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748342940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152157824:0@lo:400:kworker.0 00000100:00100000:2.0:1787853654.858815:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c24d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152158336:0@lo:400:kworker.0 00000100:00100000:1.0:1787853654.860778:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152158592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2240us (2980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853654.860795:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1787853654.860842:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853654.860851:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787853654.860854:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853654.860919:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927500d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152158080:0@lo:400:kworker.0 00000100:00100000:1.0:1787853654.860948:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748345e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152158592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853654.860963:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748340b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152157952:0@lo:400:kworker.0 00000100:00100000:1.0:1787853654.860974:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276f6f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152158464:0@lo:400:kworker.0 00010000:00010000:0.0:1787853654.926820:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853655.948082:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853656.967268:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853657.532980:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853657.533022:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853657.533062:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853657.533089:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853657.533112:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853657.533135:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136451712 00000100:00100000:2.0:1787853657.533142:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136451712 00000100:00100000:2.0:1787853657.533196:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136451328 00000100:00100000:2.0:1787853657.533198:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136451328 00000100:00100000:2.0:1787853657.533218:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 162 00000100:00100000:2.0:1787853657.533228:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c24d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:2363:x1874700136451712:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853657.533293:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c24d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:2363:x1874700136451712:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 67us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853657.533301:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 162 00000100:00100000:2.0:1787853657.533317:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 163 00000100:00100000:2.0:1787853657.533323:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748343c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:2363:x1874700136451328:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853657.533360:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748343c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:2363:x1874700136451328:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 36us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853657.533367:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 163 00000100:00100000:2.0:1787853657.533384:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136451456 00000100:00100000:2.0:1787853657.533387:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136451456 00000100:00100000:2.0:1787853657.533408:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136451584 00000100:00100000:2.0:1787853657.533411:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136451584 00000100:00100000:2.0:1787853657.533429:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 80 00000100:00100000:2.0:1787853657.533435:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748386580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2363:x1874700136451456:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853657.533461:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748386580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2363:x1874700136451456:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 25us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853657.533468:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 80 00000100:00100000:2.0:1787853657.533479:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:2.0:1787853657.533485:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748340b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2363:x1874700136451584:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853657.533506:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748340b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2363:x1874700136451584:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 22us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853657.533512:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:1.0:1787853657.533759:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136451200 00000100:00100000:1.0:1787853657.533770:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136451200 00000100:00100000:1.0:1787853657.533808:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 299 00000100:00100000:1.0:1787853657.533816:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992747b69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2363:x1874700136451200:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853657.533856:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992747b69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2363:x1874700136451200:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 41us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853657.533864:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 299 00000100:00080000:1.0:1787853657.533892:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787853657.533896:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787853657.533898:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853657.925990:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748342940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152158720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853657.926059:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853657.926348:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152158720 00000100:00100000:2.0:1787853657.926356:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152158720 00000100:00100000:2.0:1787853657.926422:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787853657.926432:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152158720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853657.926464:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853657.926517:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152158720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853657.926524:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787853657.926640:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748342940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152158720:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787853657.926706:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787853657.991110:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853658.907907:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853658.908067:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136451968 00000100:00100000:3.0:1787853658.908077:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136451968 00000100:00100000:3.0:1787853658.908131:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:3.0:1787853658.908141:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748342940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+19:12324:x1874700136451968:12345-192.168.206.10@tcp:35:umount.0 00000100:00100000:3.0:1787853658.909147:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748342940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+20:12324:x1874700136451968:12345-192.168.206.10@tcp:35:umount.0 Request processed in 1003us (1243us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787853658.909156:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 66 00000100:00100000:0.0:1787853658.916663:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853658.916822:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136452224 00000100:00100000:3.0:1787853658.916831:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136452224 00000100:00100000:3.0:1787853658.916916:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 67 00000100:00100000:3.0:1787853658.916926:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+20:12324:x1874700136452224:12345-192.168.206.10@tcp:35:umount.0 00000100:00100000:3.0:1787853658.918043:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+21:12324:x1874700136452224:12345-192.168.206.10@tcp:35:umount.0 Request processed in 1113us (1382us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787853658.918054:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 67 00000100:00100000:2.0:1787853658.922233:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853658.922335:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136452480 00000100:00100000:0.0:1787853658.922346:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136452480 00000100:00100000:0.0:1787853658.922532:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:0.0:1787853658.922542:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99274f704450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+21:12324:x1874700136452480:12345-192.168.206.10@tcp:35:umount.0 00000100:00100000:0.0:1787853658.923272:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99274f704450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:12324:x1874700136452480:12345-192.168.206.10@tcp:35:umount.0 Request processed in 728us (1044us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787853658.923282:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 68 00000100:00100000:2.0:1787853658.926017:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853658.926108:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136452736 00000100:00100000:3.0:1787853658.926116:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136452736 00000100:00100000:3.0:1787853658.926187:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:3.0:1787853658.926195:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+22:12324:x1874700136452736:12345-192.168.206.10@tcp:35:umount.0 00000100:00100000:3.0:1787853658.926530:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+23:12324:x1874700136452736:12345-192.168.206.10@tcp:35:umount.0 Request processed in 335us (573us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1787853658.926538:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 69 00000100:00100000:2.0:1787853658.934357:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853658.934442:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853658.934594:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853658.934595:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136452864 00000100:00100000:3.0:1787853658.934603:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136452864 00000100:00100000:3.0:1787853658.934658:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136452992 00000100:00100000:3.0:1787853658.934662:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136452992 00000100:00100000:2.0:1787853658.934666:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853658.934700:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136453120 00000100:00100000:3.0:1787853658.934704:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136453120 00000100:00100000:2.0:1787853658.934706:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136453248 00000100:00100000:2.0:1787853658.934709:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136453248 00000100:00100000:3.0:1787853658.934720:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:3.0:1787853658.934728:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748342940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7076e8b-41d6-499a-b764-6185164c5ac6+15:2362:x1874700136452864:12345-192.168.206.10@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787853658.934734:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 72 00000100:00100000:2.0:1787853658.934740:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2361:x1874700136453248:12345-192.168.206.10@tcp:9:umount.0 00010000:00010000:3.0:1787853658.934742:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853658.934759:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927429f7e00/0xcf1365f7cb0548cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1eaa expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787853658.934760:0:6673:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb054ba5 00000100:00080000:2.0:1787853658.934769:0:6673:0:(import.c:65:import_set_state_nolock()) ffff992747a35800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787853658.934774:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:2.0:1787853658.934799:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787853658.934830:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748342940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7076e8b-41d6-499a-b764-6185164c5ac6+14:2362:x1874700136452864:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 103us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853658.934837:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:3.0:1787853658.934852:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:3.0:1787853658.934857:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e68780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7076e8b-41d6-499a-b764-6185164c5ac6+13:2362:x1874700136452992:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853658.934864:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853658.934873:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927821c6c00/0xcf1365f7cb054833 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1e72 expref: 13 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853658.934880:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853658.934896:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e68780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7076e8b-41d6-499a-b764-6185164c5ac6+12:2362:x1874700136452992:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 39us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853658.934915:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:3.0:1787853658.934928:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:3.0:1787853658.934933:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7076e8b-41d6-499a-b764-6185164c5ac6+11:2364:x1874700136453120:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853658.934940:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853658.934948:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992747f70800/0xcf1365f7cb054ab7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f75 expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853658.934956:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853658.934988:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2364:x1874700136453120:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 53us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853658.934995:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:2.0:1787853658.935252:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+2:2361:x1874700136453248:12345-192.168.206.10@tcp:9:umount.0 Request processed in 511us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853658.935259:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 72 00010000:00010000:0.0:1787853658.935425:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853658.946467:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853658.946577:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136453632 00000100:00100000:1.0:1787853658.946586:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136453632 00000100:00100000:1.0:1787853658.946641:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 73 00000100:00100000:1.0:1787853658.946651:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+7:2361:x1874700136453632:12345-192.168.206.10@tcp:9:umount.0 00000020:00000080:1.0:1787853658.946707:0:6671:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb054e0d 00000020:00010000:1.0:1787853658.946715:0:6671:0:(genops.c:1921:obd_stale_export_put()) Put export ffff992743663800: total 0 00000100:00080000:1.0:1787853658.946720:0:6671:0:(import.c:65:import_set_state_nolock()) ffff992743665000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787853658.946765:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1787853658.947026:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+5:2361:x1874700136453632:12345-192.168.206.10@tcp:9:umount.0 Request processed in 375us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853658.947034:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 73 00000020:00010000:2.0:1787853658.947458:0:5813:0:(genops.c:1907:obd_stale_export_get()) Get export ffff992743663800: total 0 00010000:00010000:2.0:1787853658.947488:0:5813:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff992743663800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787853658.947550:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000043a805f/0xcf1365f7cb0551a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd214a expref: 4 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853658.947582:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006edf1f79/0xcf1365f7cb055847 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2318 expref: 3 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853658.947596:0:5813:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff992743663800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787853658.947629:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853658.947631:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853658.947633:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853658.956659:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853658.958122:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136454656 00000100:00100000:2.0:1787853658.958133:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136454656 00000100:00100000:2.0:1787853658.958210:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 240 00000100:00100000:2.0:1787853658.958219:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+23:2361:x1874700136454656:12345-192.168.206.10@tcp:39:umount.0 00000020:00000080:2.0:1787853658.958250:0:7618:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb054841 00000020:00010000:2.0:1787853658.958267:0:7618:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99277bee0000: total 0 00000100:00080000:2.0:1787853658.958272:0:7618:0:(import.c:65:import_set_state_nolock()) ffff99277bee4800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787853658.958305:0:7618:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1787853658.958777:0:5812:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99277bee0000: total 0 00010000:00010000:3.0:1787853658.958782:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853658.958822:0:5812:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99277bee0000, canceled 0 locks, left on hash table 14. 00010000:00010000:3.0:1787853658.958852:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:3.0:1787853658.958856:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787853658.958864:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196a00/0xcf1365f7cb055506 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd223f expref: 22 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853658.958882:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:3.0:1787853658.958885:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787853658.958889:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71600/0xcf1365f7cb054e68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2071 expref: 21 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853658.958901:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff992743be3f00) 00010000:00010000:3.0:1787853658.958914:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787853658.958919:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71200/0xcf1365f7cb054b0b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f83 expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853658.958923:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d6ecd6d-a011-4e2a-a67c-6551aba162fe+20:2361:x1874700136454656:12345-192.168.206.10@tcp:39:umount.0 Request processed in 705us (2272us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787853658.958931:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 240 00010000:00010000:3.0:1787853658.958940:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853658.958943:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787853658.958946:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064c600/0xcf1365f7cb05508a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd20fd expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853658.958957:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff992761dc9500) 00010000:00010000:3.0:1787853658.958959:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787853658.959041:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740030600/0xcf1365f7cb054b7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f9f expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853658.959070:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:3.0:1787853658.959072:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787853658.959076:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055728 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd22cb expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853658.959086:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:3.0:1787853658.959088:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853658.959092:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8000/0xcf1365f7cb055824 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd230a expref: 15 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853658.959101:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff992742cdd400) 00010000:00010000:3.0:1787853658.959104:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787853658.959107:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064d200/0xcf1365f7cb055227 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd216d expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853658.959261:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff992761dc9700) 00010000:00010000:3.0:1787853658.959264:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853658.959269:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992740030a00/0xcf1365f7cb054b27 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f8a expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853658.959284:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992761dc9f00) 00010000:00010000:3.0:1787853658.959286:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787853658.959291:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9000/0xcf1365f7cb05520b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2166 expref: 12 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853658.959302:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:3.0:1787853658.959304:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787853658.959307:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992747f71a00/0xcf1365f7cb055832 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2311 expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853658.959318:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853658.959320:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853658.959324:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99275064cc00/0xcf1365f7cb05516a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2135 expref: 10 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853658.959339:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff992742cdd200) 00010000:00010000:3.0:1787853658.959341:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787853658.959344:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9e00/0xcf1365f7cb055194 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2143 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853658.959357:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff992761dc9900) 00010000:00010000:3.0:1787853658.959360:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787853658.959370:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a8600/0xcf1365f7cb0557fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2303 expref: 8 pid: 7618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853658.959384:0:5812:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99277bee0000, canceled 14 locks, left on hash table 0. 00010000:00010000:3.0:1787853658.959630:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853658.959633:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853658.959635:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853659.013989:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787853659.508542:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:1.0:1787853659.508572:0:5846:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0d6ecd6d-a011-4e2a-a67c-6551aba162fe 00000001:00080000:1.0:1787853659.508578:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1787853659.508589:0:5846:0:(genops.c:885:class_export_put()) final put ffff99277bee0000/0d6ecd6d-a011-4e2a-a67c-6551aba162fe 00000020:00000080:2.0:1787853659.509339:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99277bee0000/0d6ecd6d-a011-4e2a-a67c-6551aba162fe for lustre-MDT0000 00000020:00000080:2.0:1787853659.509412:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99277bee4800 for lustre-MDT0000 00000100:00100000:1.0:1787853659.974043:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787853659.974062:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748345e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152158848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853659.974125:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853659.974220:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152158848 00000100:00100000:0.0:1787853659.974227:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152158848 00000100:00100000:0.0:1787853659.974317:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787853659.974327:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748344780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152158848:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853659.974354:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152158976:0@lo:400:kworker.0 00002000:00000024:0.0:1787853659.974355:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853659.974387:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853659.974394:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748344780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152158848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853659.974400:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787853659.974409:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642106580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1874700152159488:0@lo:400:kworker.0 00000100:00100000:2.0:1787853659.974433:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853659.974435:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152158976 00000100:00100000:0.0:1787853659.974443:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152158976 00000100:00100000:2.0:1787853659.974451:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787853659.974456:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152159104:0@lo:400:kworker.0 00000100:00100000:0.0:1787853659.974467:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787853659.974472:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152158976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853659.974475:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853659.974498:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152159488 00000100:00100000:2.0:1787853659.974502:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152159488 00000100:00100000:0.0:1787853659.974503:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152158976:12345-0@lo:400:kworker.0 Request processed in 31us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853659.974509:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787853659.974527:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152159104 00000100:00100000:2.0:1787853659.974535:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152159104 00000100:00100000:2.0:1787853659.974556:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787853659.974567:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874700152159488:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787853659.974585:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853659.974590:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787853659.974598:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874700152159488:12345-0@lo:400:kworker.0 Request processed in 37us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853659.974604:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787853659.974606:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152159232:0@lo:400:kworker.0 00000100:00100000:2.0:1787853659.974616:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787853659.974621:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642104b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152159104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853659.974629:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853659.974644:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642104b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152159104:12345-0@lo:400:kworker.0 Request processed in 23us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853659.974650:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787853659.978291:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748345e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152158848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853659.978320:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787853659.978331:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152159360:0@lo:400:kworker.0 00000100:00100000:1.0:1787853659.978528:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853659.979919:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152159360 00000100:00100000:1.0:1787853659.979931:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152159360 00000100:00100000:1.0:1787853659.980009:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787853659.980018:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748345e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152159360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853659.980158:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748345e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152159360:12345-0@lo:400:kworker.0 Request processed in 141us (1769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853659.980165:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1787853659.980189:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853659.981311:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152159360:0@lo:400:kworker.0 00000100:00100000:2.0:1787853659.982083:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152159232 00000100:00100000:2.0:1787853659.982091:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152159232 00000100:00080000:2.0:1787853659.982119:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853659.982147:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787853659.982158:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748346940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152159232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853659.982229:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748346940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152159232:12345-0@lo:400:kworker.0 Request processed in 73us (7598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853659.982236:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787853659.982271:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152159232:0@lo:400:kworker.0 00000100:00100000:0.0:1787853659.983253:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152159104:0@lo:400:kworker.0 00000100:00100000:0.0:1787853659.983268:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152158976:0@lo:400:kworker.0 00000100:00100000:0.0:1787853659.983280:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642106580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1874700152159488:0@lo:400:kworker.0 00010000:00010000:2.0:1787853660.037854:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787853660.062173:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0d6ecd6d-a011-4e2a-a67c-6551aba162fe 00000020:00000080:2.0:1787853660.062182:0:6697:0:(genops.c:885:class_export_put()) final put ffff992743663800/0d6ecd6d-a011-4e2a-a67c-6551aba162fe 00000020:00000080:3.0:1787853660.062246:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff992743663800/0d6ecd6d-a011-4e2a-a67c-6551aba162fe for lustre-OST0000 00000020:00000080:3.0:1787853660.062306:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff992743665000 for lustre-OST0000 00000040:00080000:0.0:1787853660.869941:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787853660.869961:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787853660.870360:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787853660.870367:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787853660.905099:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853660.905144:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853660.905187:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853660.905219:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136454784 00000100:00100000:0.0:1787853660.905228:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136454784 00000100:00100000:0.0:1787853660.905274:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136455040 00000100:00100000:0.0:1787853660.905278:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136455040 00000100:00100000:0.0:1787853660.905291:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136454912 00000100:00100000:0.0:1787853660.905294:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136454912 00000100:00100000:0.0:1787853660.905310:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:0.0:1787853660.905318:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7076e8b-41d6-499a-b764-6185164c5ac6+12:2365:x1874700136454784:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853660.905333:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853660.905362:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992740031400/0xcf1365f7cb054913 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ebf expref: 12 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853660.905393:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853660.905440:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7076e8b-41d6-499a-b764-6185164c5ac6+11:2365:x1874700136454784:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 121us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853660.905447:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:0.0:1787853660.905467:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:0.0:1787853660.905474:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7076e8b-41d6-499a-b764-6185164c5ac6+10:2365:x1874700136455040:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853660.905481:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853660.905492:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99275064de00/0xcf1365f7cb054ab0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1f6e expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853660.905501:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853660.905519:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7076e8b-41d6-499a-b764-6185164c5ac6+9:2365:x1874700136455040:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 46us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853660.905526:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:0.0:1787853660.905540:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:0.0:1787853660.905546:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992766151850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7076e8b-41d6-499a-b764-6185164c5ac6+8:2365:x1874700136454912:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853660.905554:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853660.905563:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992740031600/0xcf1365f7cb05491a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1ee9 expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853660.905571:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853660.905589:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992766151850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c7076e8b-41d6-499a-b764-6185164c5ac6+7:2365:x1874700136454912:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 44us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853660.905596:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:1.0:1787853660.917549:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853660.917645:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136455296 00000100:00100000:2.0:1787853660.917655:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136455296 00000100:00100000:2.0:1787853660.917753:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 241 00000100:00100000:2.0:1787853660.917765:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748345a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+6:2361:x1874700136455296:12345-192.168.206.10@tcp:39:umount.0 00000020:00000080:2.0:1787853660.917817:0:5824:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb054928 00000020:00010000:2.0:1787853660.917825:0:5824:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99277c19f000: total 0 00000100:00080000:2.0:1787853660.917830:0:5824:0:(import.c:65:import_set_state_nolock()) ffff99277c199800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787853660.917879:0:5824:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1787853660.918282:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748345a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcff1eac-63bd-47ee-ba0c-e172aa18acea+5:2361:x1874700136455296:12345-192.168.206.10@tcp:39:umount.0 Request processed in 519us (739us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1787853660.918291:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 241 00000100:00080000:1.0:1787853660.918823:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1787853660.921147:0:5813:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99277c19f000: total 0 00010000:00010000:3.0:1787853660.921210:0:5813:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99277c19f000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787853660.921245:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992761dc9f00) 00010000:00010000:3.0:1787853660.921249:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787853660.921260:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196e00/0xcf1365f7cb055855 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd231f expref: 4 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853660.921286:0:5813:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99277c19f000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787853660.921297:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853660.921299:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853660.921301:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853660.966473:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853660.966597:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136455552 00000100:00100000:2.0:1787853660.966617:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136455552 00000100:00100000:2.0:1787853660.966657:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 301 00000100:00100000:2.0:1787853660.966667:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+7:2361:x1874700136455552:12345-192.168.206.10@tcp:251:umount.0 00000020:00000080:2.0:1787853660.966750:0:5819:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb05481e 00000020:00010000:2.0:1787853660.966758:0:5819:0:(genops.c:1921:obd_stale_export_put()) Put export ffff992642916000: total 0 00000100:00080000:2.0:1787853660.966763:0:5819:0:(import.c:65:import_set_state_nolock()) ffff992642911000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787853660.966827:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7076e8b-41d6-499a-b764-6185164c5ac6+3:2361:x1874700136455552:12345-192.168.206.10@tcp:251:umount.0 Request processed in 162us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853660.966835:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 301 00000020:00010000:3.0:1787853660.967116:0:5812:0:(genops.c:1907:obd_stale_export_get()) Get export ffff992642916000: total 0 00010000:00010000:3.0:1787853660.967120:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853660.967161:0:5812:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff992642916000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787853660.967190:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927429f6400/0xcf1365f7cb0548d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd1eb1 expref: 2 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853660.967205:0:5812:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff992642916000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787853660.967214:0:5812:0:(genops.c:885:class_export_put()) final put ffff992642916000/c7076e8b-41d6-499a-b764-6185164c5ac6 00010000:00010000:3.0:1787853660.967231:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853660.967245:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853660.967247:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787853660.967733:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff992642916000/c7076e8b-41d6-499a-b764-6185164c5ac6 for MGS 00000020:00000080:2.0:1787853660.967767:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff992642911000 for MGS 00010000:00010000:3.0:1787853661.061978:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853662.089559:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787853662.595393:0:7622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0d6ecd6d-a011-4e2a-a67c-6551aba162fe 00000020:00000080:1.0:1787853662.595402:0:7622:0:(genops.c:885:class_export_put()) final put ffff992747a31800/0d6ecd6d-a011-4e2a-a67c-6551aba162fe 00000020:00000080:0.0:1787853662.595507:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff992747a31800/0d6ecd6d-a011-4e2a-a67c-6551aba162fe for lustre-OST0001 00000020:00000080:0.0:1787853662.595577:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff992747a35800 for lustre-OST0001 00000020:01000004:2.0:1787853662.775956:0:13012:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787853662.798193:0:13012:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787853662.798243:0:13012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb0548a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0548aa expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.798257:0:13012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb0548a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0548aa expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.798285:0:13012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb0548a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb0548aa expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.798292:0:13012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb0548a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb0548aa expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.798316:0:13012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787853662.798321:0:13012:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787853662.798339:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787853662.798343:0:13012:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787853662.798347:0:13012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787853662.798368:0:13012:0:(import.c:65:import_set_state_nolock()) ffff99276d1b2000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787853662.798432:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853662.798439:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb0548a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb0548aa expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853662.798446:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c6a00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1787853662.798449:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb0548a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb0548aa expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853662.798457:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb0548a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf1365f7cb0548aa expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853662.798464:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb0548a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf1365f7cb0548aa expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853662.798470:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787853662.798473:0:5813:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787853662.798475:0:5813:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787853662.798501:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb0548a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb0548aa expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853662.798507:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787853662.798531:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb0548a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb0548aa expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853662.798549:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb0548a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb0548aa expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853662.798560:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853662.798562:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853662.798570:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853662.798699:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642105a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874700152159616:0@lo:39:umount.0 00000100:00100000:0.0:1787853662.798759:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853662.798818:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853662.798826:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152159744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853662.798850:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853662.798882:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152159744 00000100:00100000:0.0:1787853662.798888:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152159744 00000100:00100000:0.0:1787853662.798930:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787853662.798938:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3297:x1874700152159744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853662.798964:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853662.798978:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927429f7400/0xcf1365f7cb0548aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf1365f7cb0548a3 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853662.798990:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853662.799021:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:3297:x1874700152159744:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853662.799028:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787853662.799064:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152159744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787853662.799738:0:7618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152159616 00000100:00100000:3.0:1787853662.799745:0:7618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152159616 00000100:00100000:3.0:1787853662.799785:0:7618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787853662.799792:0:7618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874700152159616:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787853662.799814:0:7618:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb05462d 00000100:00080000:3.0:1787853662.799822:0:7618:0:(import.c:65:import_set_state_nolock()) ffff99274367d800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787853662.799889:0:7618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3296:x1874700152159616:12345-0@lo:39:umount.0 Request processed in 97us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853662.799896:0:7618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1787853662.799903:0:7618:0:(genops.c:885:class_export_put()) final put ffff99274367f800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787853662.799928:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99274367f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787853662.799985:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99274367d800 for lustre-MDT0000 00000100:00080000:0.0:1787853662.800074:0:3296:0:(import.c:65:import_set_state_nolock()) ffff99276d1b2000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:2.0:1787853662.800279:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853662.800331:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642105a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874700152159616:0@lo:39:umount.0 00000100:00080000:3.0:1787853662.807374:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787853662.807381:0:13012:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787853662.807388:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787853662.809063:0:13012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f7a00/0xcf1365f7cb0548b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0548b8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853662.809080:0:13012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f7a00/0xcf1365f7cb0548b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0548b8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853662.809087:0:13012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f7a00/0xcf1365f7cb0548b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb0548b8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853662.809094:0:13012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9927429f7a00/0xcf1365f7cb0548b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb0548b8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853662.809156:0:13012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787853662.809177:0:13012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb0547d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0547df expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853662.809185:0:13012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb0547d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0547df expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853662.809191:0:13012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb0547d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb0547df expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853662.809198:0:13012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb0547d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb0547df expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.810277:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853662.810288:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9927429f7a00/0xcf1365f7cb0548b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb0548b8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.810297:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927429f7a00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1787853662.810301:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9927429f7a00/0xcf1365f7cb0548b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb0548b8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.810310:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9927429f7a00/0xcf1365f7cb0548b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf1365f7cb0548b8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853662.810317:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9927429f7a00/0xcf1365f7cb0548b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf1365f7cb0548b8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853662.810323:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787853662.810336:0:5813:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1787853662.810371:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9927429f7a00/0xcf1365f7cb0548b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb0548b8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.810377:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853662.810415:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9927429f7a00/0xcf1365f7cb0548b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb0548b8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.810423:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9927429f7a00/0xcf1365f7cb0548b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb0548b8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.810438:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853662.810442:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb0547d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb0547df expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.810448:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99275064ce00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1787853662.810451:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb0547d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb0547df expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.810458:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb0547d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf1365f7cb0547df expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853662.810463:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb0547d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf1365f7cb0547df expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853662.810468:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787853662.810470:0:5813:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1787853662.810481:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb0547d8 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb0547df expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.810486:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853662.810499:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb0547d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb0547df expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.810506:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853662.810507:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853662.810509:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853662.810569:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642105a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152160000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853662.810639:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853662.810715:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853662.810722:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9926421052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152159872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853662.810743:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853662.810784:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152160000 00000100:00100000:0.0:1787853662.810791:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152160000 00000100:00100000:0.0:1787853662.810830:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152159872 00000100:00100000:0.0:1787853662.810833:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152159872 00000100:00100000:0.0:1787853662.810854:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787853662.810874:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+19:3300:x1874700152160000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853662.810888:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853662.810901:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992747f70600/0xcf1365f7cb0547df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf1365f7cb0547d8 expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853662.810917:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853662.810962:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+18:3300:x1874700152160000:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853662.810969:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787853662.810987:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787853662.810994:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dade580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+17:3300:x1874700152159872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853662.811002:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853662.811010:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992747f70a00/0xcf1365f7cb0548b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf1365f7cb0548b1 expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853662.811020:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853662.811041:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dade580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:3300:x1874700152159872:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853662.811047:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787853662.811085:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9926421052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152159872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853662.811307:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642105a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3300:1874700152160000:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787853662.812288:0:13012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787853662.812298:0:13012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff99275064ce00/0xcf1365f7cb0547d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb0547df expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853662.812316:0:13012:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787853662.812326:0:13012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb054ada lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054ae1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853662.812333:0:13012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb054ada lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054ae1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853662.812340:0:13012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb054ada lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb054ae1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853662.812347:0:13012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb054ada lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb054ae1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.812379:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853662.812385:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb054ada lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb054ae1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.812392:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71400 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1787853662.812395:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb054ada lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb054ae1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.812403:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb054ada lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf1365f7cb054ae1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853662.812409:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb054ada lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf1365f7cb054ae1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853662.812414:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787853662.812417:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1787853662.812439:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb054ada lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb054ae1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.812445:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853662.812479:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb054ada lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb054ae1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.812487:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853662.812489:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853662.812491:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853662.812558:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642106580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152160128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853662.812615:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853662.812818:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152160128 00000100:00100000:2.0:1787853662.812825:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152160128 00000100:00100000:2.0:1787853662.812880:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787853662.812890:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dade940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+16:3297:x1874700152160128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787853662.812901:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853662.812913:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927429f6600/0xcf1365f7cb054ae1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf1365f7cb054ada expref: 16 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.812926:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853662.812972:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dade940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:3297:x1874700152160128:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853662.812980:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787853662.813221:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642106580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152160128:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787853662.813331:0:13012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787853662.813337:0:13012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb054ada lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb054ae1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853662.813356:0:13012:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787853662.813421:0:13012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f70200/0xcf1365f7cb05458c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054593 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853662.813430:0:13012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f70200/0xcf1365f7cb05458c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054593 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853662.813437:0:13012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f70200/0xcf1365f7cb05458c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb054593 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853662.813444:0:13012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff992747f70200/0xcf1365f7cb05458c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb054593 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.813477:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853662.813482:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff992747f70200/0xcf1365f7cb05458c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb054593 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.813489:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70200 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1787853662.813493:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff992747f70200/0xcf1365f7cb05458c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb054593 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.813500:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff992747f70200/0xcf1365f7cb05458c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf1365f7cb054593 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853662.813507:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff992747f70200/0xcf1365f7cb05458c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf1365f7cb054593 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853662.813513:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787853662.813516:0:5813:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:2.0:1787853662.813534:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff992747f70200/0xcf1365f7cb05458c lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb054593 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.813625:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787853662.813703:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1787853662.813780:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff992747f70200/0xcf1365f7cb05458c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb054593 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853662.813790:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853662.813792:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853662.813794:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853662.813837:0:13012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787853662.813842:0:13012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff992747f70200/0xcf1365f7cb05458c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb054593 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853662.813855:0:13012:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:0.0:1787853662.813859:0:13012:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787853662.813869:0:13012:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787853662.813917:0:13012:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787853662.813921:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787853662.813925:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787853662.813931:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:0.0:1787853662.813936:0:13012:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff992642915800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787853662.813952:0:13012:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff992641d62800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787853662.813958:0:13012:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff99277c19f000 bcff1eac-63bd-47ee-ba0c-e172aa18acea 192.168.206.10@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787853662.813972:0:13012:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff99276de48000) has exports, disconnecting them 00000020:00080000:0.0:1787853662.813977:0:13012:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff992642915800), last request at 1787853659 00000020:00000080:0.0:1787853662.813983:0:13012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb0547a0 00000100:00080000:0.0:1787853662.813999:0:13012:0:(import.c:65:import_set_state_nolock()) ffff992642913800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787853662.814050:0:13012:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff992642915800): rc 0 00000020:00000080:0.0:1787853662.814052:0:13012:0:(genops.c:885:class_export_put()) final put ffff992642915800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787853662.814062:0:13012:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff992641d62800), last request at 1787853659 00000020:00000080:0.0:1787853662.814065:0:13012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb0546d5 00000100:00080000:0.0:1787853662.814070:0:13012:0:(import.c:65:import_set_state_nolock()) ffff992641d66800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787853662.814079:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff992642915800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1787853662.814219:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853662.814252:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787853662.814307:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff992642913800 for lustre-MDT0000 00000020:00080000:0.0:1787853662.814324:0:13012:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff992641d62800): rc 0 00000020:00000080:0.0:1787853662.814326:0:13012:0:(genops.c:885:class_export_put()) final put ffff992641d62800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1787853662.814371:0:13012:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffad8d83d6fae0 00000100:00080000:0.0:1787853662.814389:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787853662.814393:0:13012:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1787853662.814407:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787853662.814481:0:13012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787853662.814497:0:13012:0:(import.c:65:import_set_state_nolock()) ffff992747a35000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787853662.814510:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787853662.814513:0:13012:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1787853662.814521:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787853662.814598:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276daded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1874700152160384:0@lo:9:umount.0 00000100:00100000:0.0:1787853662.814650:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853662.814722:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152160384 00000100:00100000:0.0:1787853662.814728:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152160384 00000100:00100000:0.0:1787853662.814776:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787853662.814784:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1874700152160384:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787853662.814812:0:6671:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb054722 00000100:00080000:0.0:1787853662.814818:0:6671:0:(import.c:65:import_set_state_nolock()) ffff9927441df800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787853662.814845:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787853662.815422:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642106580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152160256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787853662.815460:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853662.815611:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3296:x1874700152160384:12345-0@lo:9:umount.0 Request processed in 826us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853662.815619:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1787853662.815641:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853662.815653:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152160256 00000100:00100000:0.0:1787853662.815657:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152160256 00000100:00100000:0.0:1787853662.815711:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787853662.815718:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c912fdd2-2ba1-4aef-9721-e9a024331fd8+15:3297:x1874700152160256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853662.815729:0:8433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853662.815746:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992740031c00/0xcf1365f7cb054593 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf1365f7cb05458c expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853662.815761:0:8433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853662.815789:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c912fdd2-2ba1-4aef-9721-e9a024331fd8+14:3297:x1874700152160256:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853662.815797:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787853662.815828:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642106580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3297:1874700152160256:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853662.815846:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787853662.815854:0:13012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787853662.815937:0:13012:0:(import.c:65:import_set_state_nolock()) ffff99277bee3000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787853662.815978:0:13012:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff99276de48000) has no exports 00000100:00100000:3.0:1787853662.816330:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748342940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1874700152160512:0@lo:9:umount.0 00000100:00100000:3.0:1787853662.816362:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787853662.816402:0:3296:0:(import.c:65:import_set_state_nolock()) ffff992747a35000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787853662.816413:0:3296:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787853662.816415:0:3296:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787853662.816418:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276daded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1874700152160384:0@lo:9:umount.0 00000100:00100000:0.0:1787853662.816477:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152160512 00000100:00100000:0.0:1787853662.816482:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152160512 00000100:00100000:0.0:1787853662.816564:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787853662.816572:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1874700152160512:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787853662.816599:0:6673:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb054809 00000100:00080000:0.0:1787853662.816606:0:6673:0:(import.c:65:import_set_state_nolock()) ffff99276f6b5800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787853662.816633:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787853662.817033:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3296:x1874700152160512:12345-0@lo:9:umount.0 Request processed in 461us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853662.817040:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1787853662.817061:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787853662.817079:0:3296:0:(import.c:65:import_set_state_nolock()) ffff99277bee3000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787853662.817156:0:3296:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787853662.817159:0:3296:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787853662.817163:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748342940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1874700152160512:0@lo:9:umount.0 00000020:00000080:1.0:1787853662.817324:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff992641d62800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787853662.817366:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff992641d66800 for lustre-MDT0000 00000100:00080000:3.0:1787853662.817829:0:5820:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:0.0:1787853662.825807:0:13012:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff99276de48000) has no exports 00000020:00000080:0.0:1787853662.885728:0:13012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb0545e7 00000020:00000080:0.0:1787853662.885754:0:13012:0:(genops.c:885:class_export_put()) final put ffff992743679000/lustre-QMT0000_UUID 00000020:01000000:0.0:1787853662.885846:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787853662.885967:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787853662.885969:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff992743679000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787853662.885986:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787853662.885993:0:13012:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff99276e820000) has no exports 00000020:00000080:1.0:1787853662.886336:0:13012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb0545e0 00000020:00000080:1.0:1787853662.886347:0:13012:0:(genops.c:885:class_export_put()) final put ffff99276e82f800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787853662.886421:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787853662.886430:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787853662.886432:0:13012:0:(genops.c:885:class_export_put()) final put ffff99276e82d800/lustre-QMT0000_UUID 00000020:00000080:1.0:1787853662.886435:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff99276e82d800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787853662.886446:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1787853662.886727:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99276e82f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1787853663.111812:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853664.135332:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787853664.695060:0:5846:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bcff1eac-63bd-47ee-ba0c-e172aa18acea 00000001:00080000:3.0:1787853664.695080:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1787853664.695086:0:5846:0:(genops.c:885:class_export_put()) final put ffff99277c19f000/bcff1eac-63bd-47ee-ba0c-e172aa18acea 00000020:00000080:2.0:1787853664.695380:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99277c19f000/bcff1eac-63bd-47ee-ba0c-e172aa18acea for lustre-MDT0000 00000020:00000080:2.0:1787853664.695481:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99277c199800 for lustre-MDT0000 00000020:01000000:1.0:1787853664.901846:0:13012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9926428ba900 - data ffff992781f5ee58/ffff99274368c800 00000020:01000000:1.0:1787853664.903190:0:13012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9927517ca180 - data ffff99274fc50bd0/ffff99276e841000 00000001:00000004:1.0:1787853664.912505:0:13012:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1787853664.978542:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787853664.978554:0:13012:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1787853664.978582:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787853664.978585:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787853664.979123:0:7125:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787853664.979130:0:7125:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1787853664.979142:0:7125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787853664.980407:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787853664.980415:0:13012:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787853664.980437:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787853664.980440:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787853664.980922:0:7918:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787853664.980941:0:7918:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1787853664.980954:0:7918:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787853665.054910:0:13012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb0545af 00000020:00000080:2.0:1787853665.054936:0:13012:0:(genops.c:885:class_export_put()) final put ffff9927436b6800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787853665.055031:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9927436b6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787853665.056563:0:13012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb0545c4 00000020:00000080:2.0:1787853665.056575:0:13012:0:(genops.c:885:class_export_put()) final put ffff99276de57000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787853665.056600:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787853665.056609:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787853665.056620:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787853665.056624:0:13012:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff99274364cd70) has no exports 00000020:00000080:3.0:1787853665.056626:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99276de57000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1787853665.056839:0:13012:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787853665.056849:0:13012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb054802 00000020:00000080:2.0:1787853665.056854:0:13012:0:(genops.c:885:class_export_put()) final put ffff99276d1b4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787853665.056870:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787853665.056874:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787853665.056881:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787853665.056883:0:13012:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9927756e8000) has no exports 00000020:00000080:2.0:1787853665.056890:0:13012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb0547fb 00000020:00000080:2.0:1787853665.056893:0:13012:0:(genops.c:885:class_export_put()) final put ffff99277bee5000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787853665.056921:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99276d1b4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787853665.056942:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99277bee5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787853665.057460:0:13012:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787853665.057465:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787853665.057470:0:13012:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1787853665.057477:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787853665.057480:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787853665.057526:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853665.057533:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787853665.057539:0:13012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb05471b 00000020:00000080:2.0:1787853665.057544:0:13012:0:(genops.c:885:class_export_put()) final put ffff9927441da800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787853665.057548:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787853665.057553:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787853665.057556:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787853665.057559:0:13012:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9927500d99d0) has no exports 00000020:00000080:2.0:1787853665.057563:0:13012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb054714 00000020:00000080:2.0:1787853665.057566:0:13012:0:(genops.c:885:class_export_put()) final put ffff992747a33800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787853665.057616:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99277bee3000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787853665.057624:0:37:0:(genops.c:885:class_export_put()) final put ffff992642917800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787853665.057627:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff992642917800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787853665.057635:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787853665.057752:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9927441da800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787853665.057768:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff992747a33800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787853665.064399:0:13012:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787853665.064411:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787853665.064417:0:13012:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1787853665.064428:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787853665.064431:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787853665.064497:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853665.064511:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787853665.064551:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853665.064571:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787853665.064578:0:13012:0:(genops.c:885:class_export_put()) final put ffff992774139800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787853665.064584:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff992774139800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787853665.064594:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787853665.064961:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff992747a35000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787853665.064970:0:37:0:(genops.c:885:class_export_put()) final put ffff9926417e9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787853665.064972:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9926417e9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787853665.064987:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787853665.065505:0:13012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb0545cb 00000020:00000080:2.0:1787853665.065515:0:13012:0:(genops.c:885:class_export_put()) final put ffff99276de52000/lustre-MDD0000_UUID 00000020:01000000:2.0:1787853665.065569:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787853665.065575:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787853665.065582:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787853665.065588:0:13012:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff99276de4b3a0) has no exports 00000020:00000080:2.0:1787853665.065628:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853665.065632:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787853665.065637:0:13012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb0545d2 00000020:00000080:2.0:1787853665.065641:0:13012:0:(genops.c:885:class_export_put()) final put ffff99276de56000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787853665.066601:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99276de52000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787853665.066611:0:37:0:(genops.c:885:class_export_put()) final put ffff99276de57800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787853665.066613:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99276de57800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787853665.066619:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:2.0:1787853665.067252:0:13012:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9927436b6000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787853665.067258:0:13012:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9927436b6000 3 00000020:01000004:2.0:1787853665.067262:0:13012:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9927436b6000 from lustre-MDT0000 00000020:00000080:2.0:1787853665.067295:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853665.067304:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787853665.067307:0:13012:0:(genops.c:885:class_export_put()) final put ffff9927437fd000/lustre-MDT0000_UUID 00000020:00000080:2.0:1787853665.067309:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff9927437fd000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787853665.067319:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787853665.067364:0:13012:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787853665.067369:0:13012:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787853665.067373:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787853665.067377:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787853665.067380:0:13012:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787853665.067388:0:13012:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff992743702800 c912fdd2-2ba1-4aef-9721-e9a024331fd8 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787853665.067395:0:13012:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9927500d8000) has exports, disconnecting them 00000020:00080000:2.0:1787853665.067399:0:13012:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff992743702800), last request at 1787853448 00000020:00000080:2.0:1787853665.067417:0:13012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb054570 00000020:00010000:2.0:1787853665.067422:0:13012:0:(genops.c:1921:obd_stale_export_put()) Put export ffff992743702800: total 1 00000100:00080000:2.0:1787853665.067440:0:13012:0:(import.c:65:import_set_state_nolock()) ffff992743706800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787853665.067460:0:13012:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff992743702800): rc 0 00000020:00080000:2.0:1787853665.067466:0:13012:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9927500d8000) has no exports 00000100:00100000:2.0:1787853665.067525:0:5819:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9927443bb000:5819] 2 exiting: rc = 0 00000020:00000080:1.0:1787853665.067714:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99276de56000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1787853665.067790:0:5813:0:(genops.c:1907:obd_stale_export_get()) Get export ffff992743702800: total 0 00010000:00010000:0.0:1787853665.067999:0:5813:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff992743702800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787853665.068037:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99275064c000/0xcf1365f7cb05488e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf1365f7cb054887 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853665.068127:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99275064d600/0xcf1365f7cb054880 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf1365f7cb054879 expref: 8 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853665.068141:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99275064d800/0xcf1365f7cb05489c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf1365f7cb054895 expref: 7 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853665.068154:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927429f7600/0xcf1365f7cb054ad3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf1365f7cb054acc expref: 6 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853665.068179:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927429f6e00/0xcf1365f7cb054688 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf1365f7cb054681 expref: 5 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853665.068195:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927429f7c00/0xcf1365f7cb0548c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf1365f7cb0548bf expref: 4 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853665.068205:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99275064ca00/0xcf1365f7cb054ac5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf1365f7cb054abe expref: 3 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853665.068216:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927429f7800/0xcf1365f7cb054872 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf1365f7cb05486b expref: 2 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853665.068226:0:5813:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff992743702800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1787853665.068242:0:5813:0:(genops.c:885:class_export_put()) final put ffff992743702800/c912fdd2-2ba1-4aef-9721-e9a024331fd8 00010000:00010000:0.0:1787853665.068294:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853665.068296:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853665.068298:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853665.068329:0:5818:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff992750086200:5818] 1 exiting: rc = 0 00000100:00100000:0.0:1787853665.068408:0:5816:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff992750086800:5816] 0 exiting: rc = 1 00000100:00100000:2.0:1787853665.068771:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.068782:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.068791:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.068798:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.068817:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.068824:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.068830:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.068837:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.068842:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.068855:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.068861:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.068867:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.068873:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.068880:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.068887:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.068893:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.068900:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.068906:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.068912:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.068918:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.068923:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069048:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069071:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069078:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069084:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069091:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069097:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069103:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069110:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069117:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069135:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069141:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069146:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069152:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069158:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069164:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069170:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069175:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069181:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069187:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069193:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069198:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069204:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069211:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069217:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069223:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069229:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069235:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069240:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069245:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069252:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069258:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069264:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069270:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069276:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069282:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069289:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069295:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069301:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069308:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069314:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069320:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069326:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.069331:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1787853665.070122:0:13012:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787853665.070134:0:13012:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:1.0:1787853665.070711:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff992743702800/c912fdd2-2ba1-4aef-9721-e9a024331fd8 for MGS 00000020:00000080:1.0:1787853665.070758:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff992743706800 for MGS 00000020:01000000:2.0:1787853665.071648:0:13012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99276f6f90c0 - data ffff99274ffced80/ffff99276dc0a800 00000020:01000000:2.0:1787853665.071940:0:13012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff992748f4c1e0 - data ffff992751046360/ffff992748f41400 00000020:00000080:2.0:1787853665.072589:0:13012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb054554 00000020:00000080:2.0:1787853665.072600:0:13012:0:(genops.c:885:class_export_put()) final put ffff992743707800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787853665.072666:0:13012:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9927436b6000 from MGS, refs=2 00000020:01000004:2.0:1787853665.072695:0:13012:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9927436b6000 2 00000020:01000004:2.0:1787853665.072700:0:13012:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9927436b6000 from MGS 00000020:00000080:2.0:1787853665.072729:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853665.072736:0:13012:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787853665.072739:0:13012:0:(genops.c:885:class_export_put()) final put ffff992750c25000/MGS 00000020:00000080:2.0:1787853665.072742:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff992750c25000/MGS for MGS 00000020:01000000:2.0:1787853665.072748:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787853665.072882:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787853665.072887:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787853665.072894:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787853665.072902:0:13012:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9927660b2800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787853665.072908:0:13012:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff99276617b3a0) has exports, disconnecting them 00000020:00080000:2.0:1787853665.072913:0:13012:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9927660b2800), last request at 1787853448 00000020:00000080:2.0:1787853665.072918:0:13012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb05461f 00000020:00080000:2.0:1787853665.072938:0:13012:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9927660b2800): rc 0 00000020:00000080:2.0:1787853665.072943:0:13012:0:(genops.c:885:class_export_put()) final put ffff9927660b2800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787853665.074736:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff992743707800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787853665.075266:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9927660b2800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787853665.077755:0:13012:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787853665.077766:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787853665.077771:0:13012:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787853665.077780:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787853665.077886:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99276d1b2000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787853665.078063:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853665.078074:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787853665.078080:0:13012:0:(genops.c:885:class_export_put()) final put ffff99276d1b4800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787853665.078085:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff99276d1b4800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787853665.078095:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787853665.078384:0:13012:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9927436b6000 1 00000020:00000080:2.0:1787853665.078392:0:13012:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb054546 00000020:00000080:2.0:1787853665.078400:0:13012:0:(genops.c:885:class_export_put()) final put ffff992750c23800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787853665.078425:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787853665.078591:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787853665.078597:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787853665.078602:0:13012:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff992743648000) has no exports 00000020:00000080:1.0:1787853665.078723:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff992750c23800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1787853665.095701:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748344f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152160640:0@lo:400:kworker.0 00000400:00000100:1.0:1787853665.095770:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874700152160640 offset 0 length 224: 4 00000100:00100000:1.0:1787853665.095843:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787853665.095850:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748347c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152160768:0@lo:400:kworker.0 00000100:00100000:1.0:1787853665.095890:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853665.096097:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787853665.096109:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1874700152160896:0@lo:400:kworker.0 00000100:00100000:1.0:1787853665.096140:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853665.096177:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152160768 00000100:00100000:1.0:1787853665.096185:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152160768 00000100:00100000:1.0:1787853665.096246:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152160896 00000100:00100000:1.0:1787853665.096249:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152160896 00000100:00100000:1.0:1787853665.096267:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787853665.096275:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1874700152160768:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787853665.096284:0:5824:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787853665.096325:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748344000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1874700152160768:12345-0@lo:400:kworker.0 Request processed in 49us (435us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787853665.096332:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787853665.096349:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787853665.096354:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1874700152160896:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787853665.096358:0:5824:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787853665.096383:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1874700152160896:12345-0@lo:400:kworker.0 Request processed in 28us (243us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787853665.096389:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1787853665.096434:0:3299:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787853665.096439:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9926417ea800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787853665.096444:0:3299:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787853665.113042:0:3298:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787853665.113053:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9927756f0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787853665.113059:0:3298:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787853665.113066:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9927756f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787853665.113070:0:3298:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 178 00000100:00080000:2.0:1787853665.113080:0:3298:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9927756f0000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:2.0:1787853665.113120:0:3298:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff992642105a40 x1874700152161024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787853665.113152:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3298:1874700152160896:0@lo:400:kworker.0 00000100:00100000:0.0:1787853665.113756:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642105a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3296:1874700152161024:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1787853665.114001:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853665.114226:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152161024 00000100:00100000:2.0:1787853665.114302:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152161024 00000100:00100000:2.0:1787853665.114367:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787853665.114377:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748342940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3296:x1874700152161024:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1787853665.114400:0:5824:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787853665.114490:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748342940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3296:x1874700152161024:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 113us (649us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787853665.114498:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1787853665.114609:0:3296:0:(import.c:65:import_set_state_nolock()) ffff9927756f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787853665.115577:0:3296:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787853665.115585:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642105a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3296:1874700152161024:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1787853665.121346:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9926417ea800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787853665.121362:0:3299:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 159 00000100:00080000:1.0:1787853665.121388:0:3299:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9926417ea800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:0.0:1787853665.122547:0:3299:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff992761e68780 x1874700152161152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787853665.122583:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748347c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152160768:0@lo:400:kworker.0 00000100:00100000:0.0:1787853665.122612:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3296:1874700152161152:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787853665.123269:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853665.123336:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152161152 00000100:00100000:0.0:1787853665.123345:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152161152 00000100:00100000:0.0:1787853665.123395:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787853665.123403:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3296:x1874700152161152:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1787853665.123426:0:5825:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787853665.123482:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3296:x1874700152161152:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 78us (215us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787853665.123490:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:0.0:1787853665.124627:0:3296:0:(import.c:65:import_set_state_nolock()) ffff9926417ea800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787853665.124636:0:3296:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787853665.124640:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3296:1874700152161152:0@lo:38:ptlrpcd_00_02.0 00000020:00000080:2.0:1787853665.156015:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853665.156036:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787853665.156054:0:13012:0:(genops.c:885:class_export_put()) final put ffff9927436b1800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787853665.156061:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff9927436b1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787853665.156072:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787853665.156273:0:13012:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9927436b4800 00000020:01000000:2.0:1787853665.156305:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787853665.156310:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787853665.156316:0:13012:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787853665.156322:0:13012:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9927436499d0) has no exports 00000100:00100000:2.0:1787853665.156417:0:5824:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9927437c0a00:5824] 0 exiting: rc = 1 00000100:00100000:3.0:1787853665.156512:0:7618:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff99277c23ce00:7618] 3 exiting: rc = 0 00000001:00100000:2.0:1787853665.159311:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787853665.159321:0:6697:0:(genops.c:885:class_export_put()) final put ffff9927441d8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787853665.159482:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9927441d8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787853665.159550:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9927441df800 for lustre-OST0000 00000100:00100000:0.0:1787853665.162120:0:5826:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9927437c1200:5826] 2 exiting: rc = 0 00000100:00100000:0.0:1787853665.162293:0:5825:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff992747b6e400:5825] 1 exiting: rc = 0 00000100:00100000:2.0:1787853665.162645:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162655:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162662:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162667:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162699:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162706:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162712:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162719:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162725:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162731:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162736:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162742:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162749:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162756:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162763:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162769:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162776:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162782:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162791:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162798:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162808:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162817:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.162825:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163006:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163016:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163022:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163029:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163036:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163041:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163047:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163053:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163059:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163066:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163073:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163079:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163085:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163091:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163096:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163103:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163110:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163115:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163122:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163129:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163136:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163142:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163149:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163156:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163162:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163168:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163175:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163182:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163188:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163193:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163199:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163207:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163214:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163220:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163226:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163241:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163247:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163253:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163260:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163266:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.163272:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853665.172147:0:5827:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff99274f676a00:5827] 0 exiting: rc = 1 00000100:00100000:2.0:1787853665.172305:0:5828:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff99274f677c00:5828] 1 exiting: rc = 0 00000100:00100000:3.0:1787853665.172373:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172384:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172392:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172402:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172411:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172420:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172430:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172442:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172456:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172467:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172475:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172482:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172491:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172497:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172502:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172594:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172602:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172609:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172617:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172625:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172632:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172640:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172649:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172657:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172664:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172694:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172704:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172724:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172732:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172739:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172745:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172750:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172759:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172766:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172772:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172778:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172784:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172790:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172796:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172803:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172811:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172819:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172826:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172834:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172841:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172847:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172853:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172859:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172865:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172871:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172877:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172882:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172888:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172893:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172898:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172904:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172910:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172915:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172921:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.172990:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.173002:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.173009:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.173025:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.173033:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853665.173985:0:5829:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff99274839b400:5829] 0 exiting: rc = 1 00000100:00100000:2.0:1787853665.174184:0:5830:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff99274f670a00:5830] 1 exiting: rc = 0 00000100:00100000:3.0:1787853665.174305:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174317:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174327:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174336:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174346:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174367:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174377:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174387:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174396:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174406:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174416:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174426:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174435:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174445:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174454:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174464:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174476:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174597:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174607:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174614:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174624:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174632:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174642:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174651:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174661:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174693:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174703:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174710:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174716:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174740:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174748:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174756:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174764:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174796:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174804:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174813:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174822:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174830:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174839:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174845:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174852:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174876:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174883:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174889:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174896:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174902:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174909:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174918:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.174924:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.175036:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.175046:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.175056:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.175065:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.175095:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.175112:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.175126:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.175136:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.175142:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.175149:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.175156:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.175163:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.175170:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.175176:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.175185:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787853665.196373:0:5832:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff99274f677e00:5832] 1 exiting: rc = 0 00000100:00100000:3.0:1787853665.198295:0:5831:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff99274f677200:5831] 0 exiting: rc = 1 00000100:00100000:2.0:1787853665.198527:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198539:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198546:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198552:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198559:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198567:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198573:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198580:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198586:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198592:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198598:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198603:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198610:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198615:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198622:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198628:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198633:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198638:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198644:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198650:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198656:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198662:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198669:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198796:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198802:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198808:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198813:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198834:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198840:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198845:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198938:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198945:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198951:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198957:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198964:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198969:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198975:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198981:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198988:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.198995:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199001:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199006:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199012:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199018:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199024:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199030:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199036:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199042:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199047:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199053:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199058:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199063:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199069:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199074:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199079:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199085:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199090:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199095:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199101:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199106:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199111:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199116:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199130:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.199136:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.200023:0:5833:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff99274f676600:5833] 0 exiting: rc = 1 00000100:00100000:1.0:1787853665.200261:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff99274f671200:5834] 1 exiting: rc = 0 00000100:00100000:2.0:1787853665.200407:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200415:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200421:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200427:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200433:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200438:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200444:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200449:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200455:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200461:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200467:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200473:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200478:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200483:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200489:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200495:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200501:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200507:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200513:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200519:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200525:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200531:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200538:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200544:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200549:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200556:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200562:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200569:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200575:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200580:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200586:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200592:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200597:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200624:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200631:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200636:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200642:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200650:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200656:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200664:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200783:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200792:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200799:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200804:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200809:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200815:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200821:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200826:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200833:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200839:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200845:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200937:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200943:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200948:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200954:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200960:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200966:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200972:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200978:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200984:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200990:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.200995:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.201002:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.201008:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.202057:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff992746059000:5835] 0 exiting: rc = 1 00000100:00100000:1.0:1787853665.202522:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff99274604fa00:5836] 1 exiting: rc = 0 00000100:00100000:2.0:1787853665.202633:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202641:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202647:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202653:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202709:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202715:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202721:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202727:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202733:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202740:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202746:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202752:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202758:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202763:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202769:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202774:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202780:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202785:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202791:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202796:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202801:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202807:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202812:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202817:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202822:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202827:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202833:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202838:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202855:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202861:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202866:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202872:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202877:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202882:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202887:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202892:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202897:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202901:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202907:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202922:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202937:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202943:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202949:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202954:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202959:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202964:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202970:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202975:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202980:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202986:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202991:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.202996:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.203002:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.203007:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.203013:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.203019:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.203024:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.203030:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.203035:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.203040:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.203045:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.203050:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.203056:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.203062:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787853665.204329:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff99274839bc00:5837] 0 exiting: rc = 1 00000100:00100000:2.0:1787853665.204732:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff99274839b800:5839] 2 exiting: rc = 0 00000100:00100000:1.0:1787853665.205172:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff99274604e200:5838] 1 exiting: rc = 0 00000100:00100000:2.0:1787853665.205293:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205301:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205307:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205313:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205319:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205324:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205329:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205335:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205342:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205357:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205362:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205368:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205387:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205394:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205400:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205405:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205412:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205418:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205423:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205430:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205437:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205442:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205449:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205455:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205462:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205468:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205474:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205480:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205485:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205491:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205497:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205502:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205508:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205514:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205520:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205525:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205530:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205535:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205540:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205546:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205559:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205609:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205615:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205621:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205633:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205639:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205645:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205651:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205657:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205664:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205704:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205713:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205719:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205725:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205732:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205738:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205745:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205755:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205763:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205769:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205775:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205780:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205789:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853665.205795:0:13012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787853665.210619:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853665.210637:0:13012:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787853665.210643:0:13012:0:(genops.c:885:class_export_put()) final put ffff99275f262000/MDS_uuid 00000020:00000080:2.0:1787853665.210648:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff99275f262000/MDS_uuid for MDS 00000020:01000000:2.0:1787853665.210655:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787853665.210977:0:13012:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1787853665.266611:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853666.309791:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853667.334777:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787853667.741443:0:7622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787853667.741456:0:7622:0:(genops.c:885:class_export_put()) final put ffff99276f6b7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787853667.741548:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99276f6b7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787853667.741614:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99276f6b5800 for lustre-OST0001 00000020:01000004:2.0:1787853668.306363:0:13167:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787853668.317831:0:13167:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787853668.317892:0:13167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c6200/0xcf1365f7cb054887 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05488e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853668.317907:0:13167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c6200/0xcf1365f7cb054887 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb05488e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853668.317940:0:13167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c6200/0xcf1365f7cb054887 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb05488e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853668.317948:0:13167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9927821c6200/0xcf1365f7cb054887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb05488e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853668.317975:0:13167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787853668.317981:0:13167:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787853668.318011:0:13167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787853668.318017:0:13167:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787853668.318024:0:13167:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787853668.318032:0:13167:0:(import.c:65:import_set_state_nolock()) ffff9926417ea800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787853668.318037:0:13167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787853668.318038:0:13167:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787853668.318042:0:13167:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787853668.318473:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853668.318482:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9927821c6200/0xcf1365f7cb054887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb05488e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853668.318490:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c6200 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:0.0:1787853668.318494:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9927821c6200/0xcf1365f7cb054887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb05488e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853668.318503:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9927821c6200/0xcf1365f7cb054887 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf1365f7cb05488e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853668.318521:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9927821c6200/0xcf1365f7cb054887 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf1365f7cb05488e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853668.318527:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787853668.318530:0:5813:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787853668.318533:0:5813:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787853668.318579:0:5813:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9927821c6200/0xcf1365f7cb054887 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb05488e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853668.318707:0:5813:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853668.318743:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9927821c6200/0xcf1365f7cb054887 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb05488e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853668.318751:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9927821c6200/0xcf1365f7cb054887 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb05488e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853668.318762:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152161280:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853668.318768:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853668.318771:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853668.318773:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853668.318854:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787853668.319740:0:13167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb054895 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05489c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853668.319752:0:13167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb054895 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb05489c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853668.319760:0:13167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb054895 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb05489c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853668.319767:0:13167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb054895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb05489c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853668.319789:0:13167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853668.319805:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853668.319809:0:13167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb054acc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054ad3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853668.319813:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb054895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb05489c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853668.319821:0:13167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb054acc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054ad3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853668.319828:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927429f6c00 already unused, calling callback (ffffffffc1adac20) 00010000:00010000:2.0:1787853668.319832:0:13167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb054acc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb054ad3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787853668.319835:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb054895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb05489c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853668.319848:0:13167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb054acc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb054ad3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853668.319852:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb054895 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf1365f7cb05489c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787853668.319863:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb054895 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf1365f7cb05489c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853668.319864:0:13167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787853668.319870:0:13167:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 10000000:01000000:1.0:1787853668.319873:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787853668.319877:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787853668.319880:0:5812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:01000004:2.0:1787853668.319898:0:13167:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1787853668.319904:0:13167:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1787853668.319920:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787853668.319928:0:13167:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00010000:00010000:1.0:1787853668.319930:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb054895 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb05489c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787853668.319933:0:13167:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff99276e8233a0) has no exports 00010000:00010000:1.0:1787853668.319941:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:2.0:1787853668.319970:0:13167:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff99276e8233a0) has no exports 00010000:00010000:1.0:1787853668.319971:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb054895 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb05489c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853668.319981:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9927429f6c00/0xcf1365f7cb054895 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb05489c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853668.320000:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853668.320004:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb054acc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb054ad3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853668.320011:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71800 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:1.0:1787853668.320014:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb054acc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb054ad3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853668.320021:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb054acc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf1365f7cb054ad3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787853668.320028:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb054acc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf1365f7cb054ad3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853668.320033:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787853668.320035:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787853668.320037:0:5812:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787853668.320051:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb054acc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb054ad3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853668.320057:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787853668.320063:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb054acc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb054ad3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853668.320069:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb054acc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf1365f7cb054ad3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853668.320092:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853668.320095:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853668.320098:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853668.320503:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927483470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152161408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787853668.320572:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853668.320630:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152161280 00000100:00100000:1.0:1787853668.320633:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787853668.320640:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152161280 00000100:00100000:1.0:1787853668.320642:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748346940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152161536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787853668.320700:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152161408 00000100:00100000:3.0:1787853668.320703:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152161408 00000100:00100000:3.0:1787853668.320721:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787853668.320740:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748344b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3298:x1874700152161280:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787853668.320747:0:5809:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787853668 with bad export cookie 14921382105346033008 00000100:00100000:1.0:1787853668.320802:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853668.321315:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152161536 00000100:00100000:0.0:1787853668.321321:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152161536 00000100:00100000:0.0:1787853668.321344:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787853668.321349:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992766153c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3299:x1874700152161408:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787853668.321355:0:5811:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787853668 with bad export cookie 14921382105346033008 00000100:00100000:0.0:1787853668.321422:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992766153c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3299:x1874700152161408:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (848us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787853668.321430:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787853668.321449:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787853668.321453:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748345a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3299:x1874700152161536:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787853668.321471:0:5811:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787853668 with bad export cookie 14921382105346033008 00000100:00100000:0.0:1787853668.321500:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748345a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3299:x1874700152161536:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (699us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787853668.321507:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1787853668.321543:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787853668.322088:0:3299:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.110@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787853668.322094:0:3299:0:(import.c:65:import_set_state_nolock()) ffff992750c27000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787853668.322098:0:3299:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.110@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:2.0:1787853668.323321:0:13167:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9926428ba060 - data ffff992781f5e1b0/ffff99274368ec00 00000020:01000000:2.0:1787853668.323515:0:13167:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff992748da0d80 - data ffff992770781af8/ffff9926417bb000 00000100:00100000:3.0:1787853668.329007:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748344b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3298:x1874700152161280:12345-0@lo:103:ldlm_bl.0 Request processed in 8258us (10144us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787853668.329024:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787853668.329031:0:3298:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.110@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787853668.354297:0:3299:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.110@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787853668.354359:0:3299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787853668.354372:0:3299:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff992748344f00 x1874700152160640/t0(0) o400->MGC192.168.206.110@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787853681 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853668.354390:0:3299:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99277c78de00 x1874700152161280/t0(0) o103->MGC192.168.206.110@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787853684 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853668.354400:0:3299:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9927483470c0 x1874700152161408/t0(0) o103->MGC192.168.206.110@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787853684 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853668.354408:0:3299:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff992748346940 x1874700152161536/t0(0) o103->MGC192.168.206.110@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787853684 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787853668.354441:0:3298:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff992750c27000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1787853668.354468:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3298:1874700152161280:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1787853668.354848:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787853668.354853:0:3299:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787853668.354855:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787853668.354859:0:3299:0:(import.c:65:import_set_state_nolock()) ffff992750c27000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787853668.354865:0:3299:0:(import.c:510:import_select_connection()) MGC192.168.206.110@tcp: connect to NID 0@lo last attempt 142 00000100:00080000:1.0:1787853668.354900:0:3299:0:(import.c:624:import_select_connection()) MGC192.168.206.110@tcp: import ffff992750c27000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:0.0:1787853668.355107:0:3299:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99277c78de00 x1874700152161664/t0(0) o250->MGC192.168.206.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787853668.355158:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927483470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152161408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853668.355166:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748344f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152160640:0@lo:400:kworker.0 00000100:00100000:0.0:1787853668.355189:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748346940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3299:1874700152161536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853668.355269:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3296:1874700152161664:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1787853668.356759:0:3296:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874700152161664 offset 0 length 520: 4 00010000:00010000:1.0:1787853668.358897:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1787853668.361440:0:13167:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787853668.390610:0:13167:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb0546a4 00000020:00000080:3.0:1787853668.390625:0:13167:0:(genops.c:885:class_export_put()) final put ffff9926415d8800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787853668.390647:0:13167:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9927660b0000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787853668.390651:0:13167:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9927660b0000 2 00000020:01000004:3.0:1787853668.390655:0:13167:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9927660b0000 from lustre-OST0000 00000020:00000080:3.0:1787853668.390724:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787853668.390737:0:13167:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787853668.390740:0:13167:0:(genops.c:885:class_export_put()) final put ffff9926415da800/lustre-OST0000_UUID 00000020:00000080:3.0:1787853668.390743:0:13167:0:(genops.c:844:class_export_destroy()) destroying export ffff9926415da800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787853668.390752:0:13167:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787853668.390802:0:13167:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787853668.390807:0:13167:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787853668.390812:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787853668.390817:0:13167:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787853668.390825:0:13167:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff992641d77000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787853668.390832:0:13167:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9927500db3a0) has exports, disconnecting them 00000020:00080000:3.0:1787853668.390837:0:13167:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff992641d77000), last request at 1787853465 00000020:00000080:3.0:1787853668.390841:0:13167:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb0546ce 00000020:00080000:3.0:1787853668.390871:0:13167:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff992641d77000): rc 0 00000020:00000080:3.0:1787853668.390877:0:13167:0:(genops.c:885:class_export_put()) final put ffff992641d77000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787853668.391014:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9926415d8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787853668.391028:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff992641d77000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787853668.396859:0:13167:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787853668.396871:0:13167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787853668.396876:0:13167:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787853668.396886:0:13167:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787853668.397214:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787853668.397226:0:13167:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1787853668.397233:0:13167:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9927660b0000 1 00000020:00000080:0.0:1787853668.397242:0:13167:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb05465e 00000020:00000080:0.0:1787853668.397253:0:13167:0:(genops.c:885:class_export_put()) final put ffff9927660b5000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787853668.397307:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9926417ea800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787853668.397316:0:37:0:(genops.c:885:class_export_put()) final put ffff9926417ed800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787853668.397320:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9926417ed800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787853668.397329:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787853668.397524:0:13167:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787853668.397532:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787853668.397538:0:13167:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787853668.397768:0:13167:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff99276de499d0) has no exports 00000020:00000080:1.0:1787853668.397905:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9927660b5000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787853668.410457:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787853668.410481:0:13167:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787853668.410488:0:13167:0:(genops.c:885:class_export_put()) final put ffff9927660b3800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787853668.410493:0:13167:0:(genops.c:844:class_export_destroy()) destroying export ffff9927660b3800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787853668.410502:0:13167:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787853668.413603:0:13167:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9927660b7800 00000020:02000400:0.0:1787853668.413699:0:13167:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787853669.383661:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787853670.220981:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) c912fdd2-2ba1-4aef-9721-e9a024331fd8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787853670.220991:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) c912fdd2-2ba1-4aef-9721-e9a024331fd8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787853670.220994:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787853670.221005:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787853670.221009:0:38:0:(import.c:65:import_set_state_nolock()) ffff9927756f0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787853670.221017:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 359 00000100:00080000:2.0:1787853670.221024:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787853670.221031:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9927756f0000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:2.0:1787853670.221066:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff992642104f00 x1874700152161792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787853670.221142:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642104f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3296:1874700152161792:0@lo:38:kworker.0 00000400:00000100:0.0:1787853670.221199:0:3296:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874700152161792 offset 0 length 520: 4 00010000:00010000:0.0:1787853670.410451:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787853671.245270:0:13318:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787853671.260106:0:13318:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787853671.260186:0:13318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c7c00/0xcf1365f7cb05486b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054872 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853671.260201:0:13318:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c7c00/0xcf1365f7cb05486b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054872 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853671.260208:0:13318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c7c00/0xcf1365f7cb05486b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb054872 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853671.260215:0:13318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9927821c7c00/0xcf1365f7cb05486b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb054872 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853671.260266:0:13318:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787853671.260271:0:13318:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787853671.260292:0:13318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787853671.260304:0:13318:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff992642104f00 x1874700152161792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787853685 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853671.260327:0:13318:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787853671.260333:0:13318:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787853671.260339:0:13318:0:(import.c:65:import_set_state_nolock()) ffff9927756f0000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787853671.260358:0:13318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787853671.260363:0:13318:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff992642104f00 x1874700152161792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787853685 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853671.260370:0:13318:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787853671.260373:0:13318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:1.0:1787853671.260666:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642104f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3296:1874700152161792:0@lo:38:kworker.0 00010000:00010000:2.0:1787853671.262827:0:13318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb054879 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054880 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853671.262844:0:13318:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb054879 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054880 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853671.262850:0:13318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb054879 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb054880 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853671.262856:0:13318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb054879 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb054880 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853671.262954:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787853671.262962:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9927821c7c00/0xcf1365f7cb05486b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb054872 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853671.262969:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c7c00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:0.0:1787853671.262973:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9927821c7c00/0xcf1365f7cb05486b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb054872 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853671.262981:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9927821c7c00/0xcf1365f7cb05486b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf1365f7cb054872 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853671.262989:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9927821c7c00/0xcf1365f7cb05486b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf1365f7cb054872 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853671.263001:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787853671.263004:0:5813:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787853671.263007:0:5813:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787853671.263020:0:5813:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff992750c27000 00010000:00010000:0.0:1787853671.263024:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9927821c7c00/0xcf1365f7cb05486b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf1365f7cb054872 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853671.263044:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9927821c7c00/0xcf1365f7cb05486b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf1365f7cb054872 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853671.263059:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853671.263063:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb054879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb054880 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853671.263068:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c7a00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:0.0:1787853671.263071:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb054879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb054880 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853671.263077:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb054879 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf1365f7cb054880 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853671.263084:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb054879 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf1365f7cb054880 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853671.263089:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787853671.263091:0:5813:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1787853671.263096:0:5813:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff992750c27000 00010000:00010000:0.0:1787853671.263099:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb054879 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf1365f7cb054880 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853671.263105:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853671.263107:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853671.263109:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853671.263212:0:13318:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787853671.263217:0:13318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb054879 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf1365f7cb054880 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853671.263230:0:13318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb054abe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb054ac5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853671.263237:0:13318:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb054abe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb054ac5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853671.263243:0:13318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb054abe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb054ac5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853671.263259:0:13318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb054abe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf1365f7cb054ac5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853671.263278:0:13318:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787853671.263282:0:13318:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1787853671.263286:0:13318:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787853671.263307:0:13318:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787853671.263311:0:13318:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787853671.263316:0:13318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787853671.263322:0:13318:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787853671.263326:0:13318:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff99276e8219d0) has no exports 00000020:00080000:2.0:1787853671.263348:0:13318:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff99276e8219d0) has no exports 00010000:00010000:3.0:1787853671.263577:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853671.263582:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb054abe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb054ac5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853671.263589:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927429f6200 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:3.0:1787853671.263592:0:5813:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb054abe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf1365f7cb054ac5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853671.263609:0:5813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb054abe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf1365f7cb054ac5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853671.263616:0:5813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb054abe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf1365f7cb054ac5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853671.263622:0:5813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787853671.263625:0:5813:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787853671.263627:0:5813:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787853671.263634:0:5813:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff992750c27000 00010000:00010000:3.0:1787853671.263637:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb054abe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf1365f7cb054ac5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853671.263643:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9927429f6200/0xcf1365f7cb054abe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf1365f7cb054ac5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853671.263658:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853671.263660:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853671.263662:0:5813:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853671.264871:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787853671.267855:0:13318:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9926428ba780 - data ffff992781f6aa20/ffff99277c5ae800 00000020:01000000:3.0:1787853671.268102:0:13318:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99277c180360 - data ffff992781e66af8/ffff9926435a0000 00100000:10000000:3.0:1787853671.282528:0:13318:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787853671.325393:0:13318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb05476f 00000020:00000080:3.0:1787853671.325403:0:13318:0:(genops.c:885:class_export_put()) final put ffff99276de56800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787853671.325423:0:13318:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9927441ba000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787853671.325426:0:13318:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9927441ba000 2 00000020:01000004:3.0:1787853671.325430:0:13318:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9927441ba000 from lustre-OST0001 00000020:00000080:3.0:1787853671.325455:0:13318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787853671.325465:0:13318:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787853671.325468:0:13318:0:(genops.c:885:class_export_put()) final put ffff9926415de800/lustre-OST0001_UUID 00000020:00000080:3.0:1787853671.325470:0:13318:0:(genops.c:844:class_export_destroy()) destroying export ffff9926415de800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787853671.325478:0:13318:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787853671.325577:0:13318:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c912fdd2-2ba1-4aef-9721-e9a024331fd8->MGS 00010000:00010000:3.0:1787853671.325593:0:13318:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff99275064c400/0xcf1365f7cb054681 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf1365f7cb054688 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853671.325604:0:13318:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff99275064c400/0xcf1365f7cb054681 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf1365f7cb054688 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853671.325611:0:13318:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787853671.325614:0:13318:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787853671.325617:0:13318:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787853671.325630:0:13318:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff992750c27000 00010000:00010000:3.0:1787853671.325634:0:13318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff99275064c400/0xcf1365f7cb054681 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf1365f7cb054688 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853671.325648:0:13318:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9927821c6400/0xcf1365f7cb0548bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf1365f7cb0548c6 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787853671.325655:0:13318:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9927821c6400/0xcf1365f7cb0548bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf1365f7cb0548c6 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787853671.325752:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99276de56800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:3.0:1787853671.325917:0:13318:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787853671.325920:0:13318:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787853671.325921:0:13318:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787853671.325931:0:13318:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff992750c27000 00010000:00010000:3.0:1787853671.325934:0:13318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9927821c6400/0xcf1365f7cb0548bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf1365f7cb0548c6 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787853671.325951:0:13318:0:(import.c:65:import_set_state_nolock()) ffff992750c27000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787853671.325956:0:13318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787853671.325958:0:13318:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787853671.325959:0:13318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787853671.325963:0:13318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787853671.325973:0:13318:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99277c78de00 x1874700152161664/t0(0) o250->MGC192.168.206.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787853678 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787853671.325994:0:13318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787853671.325996:0:13318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1787853671.326805:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c912fdd2-2ba1-4aef-9721-e9a024331fd8:3296:1874700152161664:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:3.0:1787853671.327010:0:13318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787853671.327019:0:13318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb054562 00000020:00000080:3.0:1787853671.327026:0:13318:0:(genops.c:885:class_export_put()) final put ffff992750c23000/c912fdd2-2ba1-4aef-9721-e9a024331fd8 00000020:01000000:3.0:1787853671.327044:0:13318:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.110@tcp (flags='') 00000020:00000080:3.0:1787853671.327051:0:13318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787853671.327057:0:13318:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.110@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787853671.327061:0:13318:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff99274364b3a0) has no exports 00000020:00000080:2.0:1787853671.327120:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff992750c23000/c912fdd2-2ba1-4aef-9721-e9a024331fd8 for MGC192.168.206.110@tcp 10000000:01000000:0.0:1787853671.327175:0:5821:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787853671.327261:0:13318:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.206.110@tcp: client import never connected 00000100:00080000:3.0:1787853671.327265:0:13318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787853671.327268:0:13318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787853671.327270:0:13318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787853671.327272:0:13318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787853671.327316:0:13318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787853671.327321:0:13318:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.110@tcp (uuid c912fdd2-2ba1-4aef-9721-e9a024331fd8) 00000020:01000000:3.0:1787853671.327326:0:13318:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787853671.327335:0:13318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787853671.327339:0:13318:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787853671.327343:0:13318:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9927756f4000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787853671.327349:0:13318:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9927756ecd70) has exports, disconnecting them 00000020:00080000:3.0:1787853671.327353:0:13318:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9927756f4000), last request at 1787853484 00000020:00000080:3.0:1787853671.327357:0:13318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb054799 00000020:00080000:3.0:1787853671.327369:0:13318:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9927756f4000): rc 0 00000020:00000080:3.0:1787853671.327372:0:13318:0:(genops.c:885:class_export_put()) final put ffff9927756f4000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787853671.327856:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff992750c27000 for MGC192.168.206.110@tcp 00000020:00000080:2.0:1787853671.327863:0:37:0:(genops.c:885:class_export_put()) final put ffff99275f261800/c912fdd2-2ba1-4aef-9721-e9a024331fd8 00000020:00000080:2.0:1787853671.327865:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99275f261800/c912fdd2-2ba1-4aef-9721-e9a024331fd8 for MGC192.168.206.110@tcp 00000020:01000000:2.0:1787853671.327871:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.110@tcp (c912fdd2-2ba1-4aef-9721-e9a024331fd8) 00000020:00000080:2.0:1787853671.328125:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9927756f4000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787853671.331339:0:13318:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787853671.331347:0:13318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787853671.331351:0:13318:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787853671.331359:0:13318:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787853671.331429:0:5813:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787853671.331564:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:0.0:1787853671.331647:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9927756f0000 for lustre-MDT0000-lwp-OST0001 00000100:00100000:3.0:1787853671.331960:0:5808:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9927463b6800:5808] 1 exiting: rc = 0 00000100:00100000:1.0:1787853671.332369:0:5807:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9927463b7a00:5807] 0 exiting: rc = 1 00000100:00100000:2.0:1787853671.332508:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.332802:0:5811:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff992747a9fa00:5811] 2 exiting: rc = 0 00000100:00100000:0.0:1787853671.332871:0:8433:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff992775487000:8433] 3 exiting: rc = 0 00000100:00100000:0.0:1787853671.332954:0:5810:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff992744176200:5810] 1 exiting: rc = 0 00000100:00100000:3.0:1787853671.333235:0:5809:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff992747a9e400:5809] 0 exiting: rc = 1 00000100:00100000:2.0:1787853671.333367:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333375:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333382:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333400:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333406:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333412:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333417:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333423:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333428:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333434:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333440:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333445:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333451:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333457:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333464:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333471:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333477:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333483:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333488:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333494:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333499:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333504:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333509:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333513:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333518:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333523:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333528:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333533:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333537:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333542:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333547:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333552:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333558:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333562:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333567:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333572:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333579:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333584:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333597:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333602:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333607:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333612:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333616:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333620:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333625:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333629:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333634:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333639:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333644:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333649:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333654:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333659:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333664:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333669:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333708:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333713:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333719:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333724:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333730:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333735:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333741:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333746:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333752:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.333757:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787853671.334631:0:13318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787853671.334642:0:13318:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787853671.334648:0:13318:0:(genops.c:885:class_export_put()) final put ffff9927756f5000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787853671.334653:0:13318:0:(genops.c:844:class_export_destroy()) destroying export ffff9927756f5000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787853671.334659:0:13318:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1787853671.334729:0:13318:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9927441ba000 1 00000020:00000080:2.0:1787853671.334735:0:13318:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf1365f7cb05473e 00000020:00000080:2.0:1787853671.334741:0:13318:0:(genops.c:885:class_export_put()) final put ffff99276de54800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787853671.334761:0:13318:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787853671.334776:0:13318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787853671.334782:0:13318:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787853671.334786:0:13318:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9927756e99d0) has no exports 00000020:00000080:0.0:1787853671.334957:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99276de54800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787853671.352081:0:13318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787853671.352095:0:13318:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787853671.352100:0:13318:0:(genops.c:885:class_export_put()) final put ffff9927441b9800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787853671.352104:0:13318:0:(genops.c:844:class_export_destroy()) destroying export ffff9927441b9800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787853671.352111:0:13318:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787853671.352301:0:13318:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9927441be000 00000020:01000000:0.0:1787853671.352323:0:13318:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787853671.352327:0:13318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787853671.352331:0:13318:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787853671.352335:0:13318:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff99276de4cd70) has no exports 00000020:00000080:0.0:1787853671.352360:0:13318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787853671.352366:0:13318:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787853671.352369:0:13318:0:(genops.c:885:class_export_put()) final put ffff9927660b3000/OSS_uuid 00000020:00000080:0.0:1787853671.352372:0:13318:0:(genops.c:844:class_export_destroy()) destroying export ffff9927660b3000/OSS_uuid for OSS 00000020:01000000:0.0:1787853671.352376:0:13318:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1787853671.352440:0:6672:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9927443fb400:6672] 1 exiting: rc = 0 00000100:00100000:0.0:1787853671.352521:0:6673:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9927443fae00:6673] 2 exiting: rc = 0 00000100:00100000:0.0:1787853671.352564:0:11669:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9926417e5400:11669] 3 exiting: rc = 0 00000100:00100000:0.0:1787853671.352605:0:6671:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff99274824bc00:6671] 0 exiting: rc = 1 00000100:00100000:0.0:1787853671.352652:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.352659:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.352665:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.352698:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.352704:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.352721:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.352726:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.352730:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.352735:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.352739:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.352743:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.352747:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.352752:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.352756:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.352761:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.352964:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353010:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353017:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353021:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353027:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353032:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353037:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353041:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353046:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353050:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353055:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353590:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353599:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353604:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353609:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353613:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353618:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353623:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353628:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353633:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353638:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353644:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353650:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353656:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353661:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353694:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353700:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353704:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353709:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353713:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353717:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353722:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353726:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353731:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353735:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353740:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353744:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353749:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353754:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.353759:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.354865:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.354879:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.354884:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.354888:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.354902:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.354908:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.354913:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.354918:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.354930:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:3.0:1787853671.356403:0:5820:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787853671.356563:0:6674:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9927443fa400:6674] 0 exiting: rc = 1 00000100:00100000:1.0:1787853671.356713:0:6675:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff99277bf74000:6675] 1 exiting: rc = 0 00000100:00100000:2.0:1787853671.366654:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.366666:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.366688:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.366694:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.366700:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.366704:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.366709:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.366714:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.366719:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.366724:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.366729:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.366734:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.366740:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.366745:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.366750:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.366754:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.366759:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.366885:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.366890:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.366989:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367084:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367091:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367096:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367192:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367201:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367206:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367211:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367216:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367281:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367290:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367307:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367317:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367322:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367327:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367332:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367337:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367342:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367351:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367356:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367362:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367367:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367372:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367376:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367381:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367385:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367391:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367403:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367409:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367538:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367543:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367548:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367553:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367562:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367572:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367579:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367585:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367590:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367594:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367603:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367608:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367613:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367617:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367622:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.367627:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.370180:0:6676:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff99275874a000:6676] 0 exiting: rc = 1 00000100:00100000:0.0:1787853671.372705:0:6677:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff99275874a200:6677] 1 exiting: rc = 0 00000100:00100000:3.0:1787853671.374042:0:6678:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9927443fba00:6678] 2 exiting: rc = 0 00000100:00100000:2.0:1787853671.374208:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374216:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374222:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374227:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374232:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374238:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374244:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374249:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374254:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374259:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374264:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374270:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374275:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374280:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374295:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374301:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374306:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374312:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374317:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374321:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374327:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374332:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374337:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374342:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374348:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374353:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374358:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374363:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374368:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374373:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374381:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374387:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374392:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374397:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374404:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374426:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374433:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374443:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374471:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374480:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374487:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374492:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374498:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374503:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374660:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374725:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374733:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374740:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374745:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374750:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374755:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374760:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374978:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374987:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.374995:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.375003:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.375011:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.375021:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.375027:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.376030:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.376043:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.376049:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.376055:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.376060:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.390253:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff992766144200:6679] 0 exiting: rc = 1 00000100:00100000:2.0:1787853671.390520:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff99276e866a00:6680] 1 exiting: rc = 0 00000100:00100000:2.0:1787853671.390581:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390587:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390592:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390597:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390602:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390620:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390627:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390632:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390637:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390642:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390647:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390651:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390656:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390660:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390665:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390862:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390871:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390876:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390882:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390886:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390891:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390971:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390978:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390982:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390987:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390992:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.390997:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391002:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391007:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391012:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391017:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391022:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391027:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391032:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391036:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391041:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391046:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391051:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391057:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391062:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391075:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391079:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391085:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391091:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391096:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391101:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391107:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391112:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391118:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391123:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391128:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391133:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391138:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391143:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391149:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391154:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391160:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391165:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391170:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391175:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391180:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391185:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391190:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.391196:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787853671.392197:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff99274824a600:6681] 0 exiting: rc = 1 00000100:00100000:1.0:1787853671.398024:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff992745867600:6682] 1 exiting: rc = 0 00000100:00100000:2.0:1787853671.398205:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398214:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398220:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398226:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398232:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398240:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398246:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398252:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398257:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398275:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398282:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398299:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398305:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398310:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398315:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398321:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398326:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398332:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398338:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398344:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398350:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398369:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398378:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398383:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398388:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398396:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398402:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398408:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398414:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398419:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398426:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398431:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398437:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398457:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398464:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398469:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398474:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398480:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398486:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398492:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398497:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398507:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398524:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398531:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398538:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398557:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398569:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398575:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398581:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398587:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398593:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398599:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398606:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398612:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398619:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398624:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398630:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398649:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398656:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398663:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398699:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398707:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398712:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787853671.398718:0:13318:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787853671.421005:0:13318:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787853687.021313:0:13933:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787853694.712803:0:14395:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787853694.712808:0:14395:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787853694.712940:0:14395:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff992641d72000 00000020:01000004:3.0:1787853694.712955:0:14395:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787853694.712962:0:14395:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787853694.712975:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9927500dcd70) 00000020:00000080:3.0:1787853694.712987:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787853694.724738:0:14395:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787853694.726475:0:14395:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787853694.726997:0:14395:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787853694.727065:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 401: rc = 0 00100000:10000000:3.0:1787853694.727162:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 401: rc = 0 00100000:10000000:3.0:1787853694.727254:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 401: rc = 0 00100000:10000000:3.0:1787853694.727398:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 401: rc = 0 00100000:10000000:3.0:1787853694.727494:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 401: rc = 0 00100000:10000000:3.0:1787853694.727588:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 401: rc = 0 00100000:10000000:3.0:1787853694.727906:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 403: rc = 0 00100000:10000000:3.0:1787853694.728812:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 642: rc = 0 00100000:10000000:3.0:1787853694.728902:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 642: rc = 0 00100000:10000000:3.0:1787853694.729349:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 646: rc = 0 00100000:10000000:3.0:1787853694.729564:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 646: rc = 0 00100000:10000000:3.0:1787853694.729900:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 646: rc = 0 00100000:10000000:3.0:1787853694.730131:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 646: rc = 0 00100000:10000000:3.0:1787853694.730361:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 646: rc = 0 00100000:10000000:3.0:1787853694.730567:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 646: rc = 0 00100000:10000000:3.0:1787853694.730938:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 646: rc = 0 00100000:10000000:3.0:1787853694.731188:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 646: rc = 0 00100000:10000000:3.0:1787853694.731421:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 646: rc = 0 00100000:10000000:3.0:1787853694.731656:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 646: rc = 0 00100000:10000000:3.0:1787853694.731985:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 646: rc = 0 00100000:10000000:3.0:1787853694.732199:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 646: rc = 0 00100000:10000000:3.0:1787853694.732557:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 559: rc = 0 00100000:10000000:3.0:1787853694.732848:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 559: rc = 0 00100000:10000000:3.0:1787853694.733077:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 559: rc = 0 00100000:10000000:3.0:1787853694.733299:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 559: rc = 0 00100000:10000000:3.0:1787853694.733519:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 559: rc = 0 00100000:10000000:3.0:1787853694.733874:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 559: rc = 0 00100000:10000000:3.0:1787853694.734110:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 559: rc = 0 00100000:10000000:3.0:1787853694.734800:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 559: rc = 0 00100000:10000000:3.0:1787853694.735062:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 559: rc = 0 00100000:10000000:3.0:1787853694.735311:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 559: rc = 0 00100000:10000000:3.0:1787853694.735559:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 559: rc = 0 00100000:10000000:3.0:1787853694.735903:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 559: rc = 0 00100000:10000000:3.0:1787853694.736136:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 559: rc = 0 00100000:10000000:3.0:1787853694.736390:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 559: rc = 0 00100000:10000000:3.0:1787853694.736612:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 559: rc = 0 00100000:10000000:3.0:1787853694.736875:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 559: rc = 0 00100000:10000000:3.0:1787853694.737109:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 559: rc = 0 00100000:10000000:3.0:1787853694.737353:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 559: rc = 0 00100000:10000000:3.0:1787853694.737582:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 559: rc = 0 00100000:10000000:3.0:1787853694.737926:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 559: rc = 0 00100000:10000000:3.0:1787853694.738158:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 559: rc = 0 00100000:10000000:3.0:1787853694.738403:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 559: rc = 0 00100000:10000000:3.0:1787853694.738756:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 559: rc = 0 00100000:10000000:3.0:1787853694.739014:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 559: rc = 0 00100000:10000000:3.0:1787853694.739231:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 559: rc = 0 00100000:10000000:3.0:1787853694.739456:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 559: rc = 0 00100000:10000000:3.0:1787853694.739669:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 559: rc = 0 00100000:10000000:3.0:1787853694.739961:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 559: rc = 0 00100000:10000000:3.0:1787853694.740197:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 559: rc = 0 00100000:10000000:3.0:1787853694.740443:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 559: rc = 0 00100000:10000000:3.0:1787853694.740708:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 559: rc = 0 00100000:10000000:3.0:1787853694.741024:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 559: rc = 0 00100000:10000000:3.0:1787853694.741365:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 651: rc = 0 00100000:10000000:3.0:1787853694.742113:0:14395:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787853694.742287:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 643: rc = 0 00100000:10000000:3.0:1787853694.742471:0:14395:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787853694.742536:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 643: rc = 0 00100000:10000000:3.0:1787853694.742805:0:14395:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787853694.742876:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 643: rc = 0 00100000:10000000:3.0:1787853694.743215:0:14395:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787853694.743284:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 324: rc = 0 00100000:10000000:3.0:1787853694.743466:0:14395:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787853694.743531:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 324: rc = 0 00100000:10000000:3.0:1787853694.743748:0:14395:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787853694.743830:0:14395:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 324: rc = 0 00000020:00000080:3.0:1787853694.744068:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787853694.744077:0:14395:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787853694.744086:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf1365f7cb055863 00000020:01000004:3.0:1787853694.744094:0:14395:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787853694.744098:0:14395:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787853694.744103:0:14395:0:(tgt_mount.c:101:server_register_mount()) register mount ffff992641d72000 from MGS 00000020:01000004:3.0:1787853694.744106:0:14395:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787853694.744114:0:14395:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9927500db3a0) 00000020:00000080:3.0:1787853694.744123:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787853694.744175:0:14395:0:(tgt_mount.c:153:server_get_mount()) get mount ffff992641d72000 from MGS, refs=2 00080000:01000000:3.0:1787853694.744180:0:14395:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787853694.744188:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf1365f7cb055871 00000100:00100000:3.0:1787853694.744274:0:14395:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787853694.744397:0:14395:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787853694.744403:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787853694.745103:0:14395:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787853694.745111:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787853694.745655:0:14395:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787853694.745991:0:14395:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787853694.745996:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787853694.746372:0:14395:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787853694.746378:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787853694.746755:0:14395:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787853694.746761:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787853694.747541:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853694.747545:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853694.747546:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853694.747971:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853694.747973:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853694.747975:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853694.748406:0:14395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787853694.752810:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787853694.762331:0:14395:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787853694.762347:0:14395:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787853694.762350:0:14395:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787853694.763721:0:14404:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787853694.763865:0:14395:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787853694.763958:0:14395:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787853694.764392:0:14395:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787853694.764878:0:14395:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787853694.765022:0:14395:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787853694.765033:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787853694.767520:0:14395:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787853694.767534:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787853694.772280:0:14395:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787853694.772293:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787853694.773006:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787853694.773025:0:14395:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.110@tcp' 00000020:01000004:1.0:1787853694.773027:0:14395:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787853694.773056:0:14395:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.110@tcp (typ=mgc) 00000020:00000080:1.0:1787853694.773069:0:14395:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.110@tcp (ffff99276e820000) 00000020:00000080:1.0:1787853694.773083:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787853694.773153:0:14395:0:(ldlm_lib.c:102:import_set_conn()) imp ffff992750c07000@MGC192.168.206.110@tcp: add connection 192.168.206.110@tcp at head 00010000:00010000:1.0:1787853694.773291:0:14395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.110@tcp-0 is initialized 00000040:01000000:1.0:1787853694.773296:0:14395:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787853694.773390:0:14409:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787853694.774252:0:14410:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787853694.774313:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.110@tcp (uuid 606eab1b-a99f-4bb0-a1c7-11b5915f771c) 00000020:00000080:3.0:1787853694.774329:0:14395:0:(genops.c:1385:class_connect()) connect: client 606eab1b-a99f-4bb0-a1c7-11b5915f771c, cookie 0xcf1365f7cb05587f 00000100:00080000:3.0:1787853694.774339:0:14395:0:(import.c:510:import_select_connection()) MGC192.168.206.110@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787853694.774344:0:14395:0:(import.c:624:import_select_connection()) MGC192.168.206.110@tcp: import ffff992750c07000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:3.0:1787853694.774384:0:14395:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99277522f0c0 x1874700152161920/t0(0) o250->MGC192.168.206.110@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787853694.774410:0:14395:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 606eab1b-a99f-4bb0-a1c7-11b5915f771c->MGS 00000020:01000004:3.0:1787853694.774428:0:14395:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787853694.774432:0:14395:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787853694.774442:0:14395:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9927500d8000) 00000020:00000080:3.0:1787853694.774459:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787853694.774578:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3296:1874700152161920:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787853694.774638:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853694.774723:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152161920 00000100:00100000:0.0:1787853694.774730:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152161920 00000100:00100000:0.0:1787853694.774754:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787853694.774761:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dca8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3296:x1874700152161920:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787853694.774792:0:14405:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from 606eab1b-a99f-4bb0-a1c7-11b5915f771c@0@lo t0 exp 0000000000000000 cur 389 last 0 00000020:00000080:0.0:1787853694.774813:0:14405:0:(genops.c:1385:class_connect()) connect: client 606eab1b-a99f-4bb0-a1c7-11b5915f771c, cookie 0xcf1365f7cb05588d 00000100:00080000:0.0:1787853694.774920:0:14405:0:(import.c:65:import_set_state_nolock()) ffff992641d62800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853694.774967:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dca8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+5:3296:x1874700152161920:12345-0@lo:250:mount.lustre.0 Request processed in 205us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853694.774975:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787853694.775015:0:3296:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.110@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787853694.775023:0:3296:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.110@tcp: connect to target with instance 0 00000100:00080000:0.0:1787853694.775029:0:3296:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.110@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787853694.775032:0:3296:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787853694.775036:0:3296:0:(import.c:65:import_set_state_nolock()) ffff992750c07000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787853694.775038:0:3296:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787853694.775044:0:3296:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787853694.775049:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3296:1874700152161920:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787853694.791337:0:14395:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787853694.791523:0:14395:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787853694.791530:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787853694.792947:0:14395:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787853694.792957:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787853694.793910:0:14395:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787853694.793919:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787853694.794531:0:14395:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787853694.794726:0:14395:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787853694.794731:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787853694.795201:0:14395:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787853694.795208:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787853694.859016:0:14395:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787853694.859209:0:14395:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787853694.859217:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787853694.861008:0:14395:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787853694.861018:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787853694.861652:0:14395:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787853694.861993:0:14395:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787853694.861999:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787853694.862584:0:14395:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787853694.862591:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787853694.863207:0:14395:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787853694.863486:0:14395:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787853694.863492:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787853694.864141:0:14395:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787853694.864148:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787853694.864977:0:14395:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787853694.865137:0:14395:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787853694.865144:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787853694.865909:0:14395:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787853694.865917:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787853694.882162:0:14395:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787853694.882559:0:14395:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787853694.882566:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787853694.884441:0:14395:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787853694.884453:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787853694.886040:0:14395:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787853694.886054:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787853694.887297:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787853694.887451:0:14395:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787853694.887458:0:14395:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.110@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787853694.887583:0:14395:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787853694.887624:0:14395:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.110@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787853694.887628:0:14395:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787853694.887630:0:14395:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787853694.887631:0:14395:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787853694.887632:0:14395:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787853694.887637:0:14395:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787853694.887638:0:14395:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787853694.887639:0:14395:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787853694.887640:0:14395:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787853694.887642:0:14395:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787853694.887643:0:14395:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787853694.887646:0:14395:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787853694.887647:0:14395:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787853694.887648:0:14395:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787853694.887649:0:14395:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787853694.887650:0:14395:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787853694.887651:0:14395:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787853694.887652:0:14395:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787853694.887653:0:14395:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787853694.887654:0:14395:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787853694.887655:0:14395:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787853694.887655:0:14395:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787853694.887926:0:14395:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787853694.887948:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9926421043c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152162048:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787853694.888015:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853694.888108:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff992746bfab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787853694.888188:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152162048 00000100:00100000:0.0:1787853694.888195:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152162048 00000100:00100000:0.0:1787853694.888280:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787853694.888290:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dca9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+5:14395:x1874700152162048:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787853694.888352:0:14408:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787853694.888355:0:14408:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787853694.888358:0:14408:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787853694.888630:0:14429:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787853694.889025:0:14408:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1787853694.890809:0:14430:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787853694.890816:0:14430:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787853694.890819:0:14430:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787853694.890856:0:14430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1787853694.891149:0:14408:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787853694.891159:0:14408:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787853694.896569:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dca9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+5:14395:x1874700152162048:12345-0@lo:253:mount.lustre.0 Request processed in 8273us (8545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853694.896587:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787853694.896904:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9926421043c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152162048:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787853694.896918:0:14395:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787853694.896922:0:14395:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787853694.896923:0:14395:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787853694.896925:0:14395:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787853694.896926:0:14395:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787853694.896927:0:14395:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787853694.896929:0:14395:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787853694.896930:0:14395:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787853694.896932:0:14395:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787853694.896934:0:14395:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787853694.896935:0:14395:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787853694.896952:0:14395:0:(tgt_mount.c:101:server_register_mount()) register mount ffff992641d72000 from lustre-MDT0000 10000000:01000000:2.0:1787853694.896980:0:14395:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787853694.896983:0:14395:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787853694.896987:0:14395:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99276e820000 10000000:01000000:2.0:1787853694.897003:0:14395:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787853694.897010:0:14395:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99276e820000 from 1 10000000:01000000:2.0:1787853694.897013:0:14395:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787853694.897048:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb055894 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853694.897059:0:14395:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb055894 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853694.897068:0:14395:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb055894 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853694.897087:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9926421043c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152162176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787853694.897127:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853694.897205:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff992746bfaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787853694.897249:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152162176 00000100:00100000:0.0:1787853694.897255:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152162176 00000100:00100000:0.0:1787853694.897445:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787853694.897456:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dcaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+5:14395:x1874700152162176:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853694.897467:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853694.897481:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927587a8800/0xcf1365f7cb05589b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb055894 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853694.897503:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927587a8800/0xcf1365f7cb05589b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb055894 expref: 6 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853694.897513:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927587a8800/0xcf1365f7cb05589b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb055894 expref: 6 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853694.897521:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a8800, rc 0) 00000100:00100000:0.0:1787853694.897565:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dcaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+6:14395:x1874700152162176:12345-0@lo:101:mount.lustre.0 Request processed in 112us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853694.897571:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787853694.897636:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9926421043c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152162176:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853694.897649:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb055894 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05589b expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853694.897658:0:14395:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb055894 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb05589b expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853694.897736:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152162304:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853694.897762:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853694.898086:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274586fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853694.898152:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152162304 00000100:00100000:2.0:1787853694.898157:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152162304 00000100:00100000:2.0:1787853694.898183:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787853694.898189:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dca9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+6:14395:x1874700152162304:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853694.898567:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dca9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+6:14395:x1874700152162304:12345-0@lo:501:mount.lustre.0 Request processed in 377us (803us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787853694.898575:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787853694.898787:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152162304:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787853694.898817:0:14395:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787853694.898891:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb055894 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05589b expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853694.898901:0:14395:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb055894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05589b expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853694.898909:0:14395:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff992641d72000 10000000:01000000:3.0:1787853694.898913:0:14395:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787853694.898917:0:14395:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff992641d72000 10000000:01000000:3.0:1787853694.898920:0:14395:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787853694.898923:0:14395:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff992641d72000 from 1 10000000:01000000:3.0:1787853694.898925:0:14395:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787853694.898949:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c6400/0xcf1365f7cb0558a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853694.898957:0:14395:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9927821c6400/0xcf1365f7cb0558a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853694.898965:0:14395:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927821c6400/0xcf1365f7cb0558a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853694.898980:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152162432:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787853694.899011:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853694.899042:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274586fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853694.899159:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152162432 00000100:00100000:2.0:1787853694.899163:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152162432 00000100:00100000:2.0:1787853694.899197:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787853694.899204:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dcab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+6:14395:x1874700152162432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787853694.899214:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853694.899226:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992747f70200/0xcf1365f7cb0558a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0558a2 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853694.899254:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992747f70200/0xcf1365f7cb0558a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0558a2 expref: 7 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853694.899262:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992747f70200/0xcf1365f7cb0558a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0558a2 expref: 7 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853694.899269:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70200, rc 0) 00000100:00100000:2.0:1787853694.899296:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dcab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+7:14395:x1874700152162432:12345-0@lo:101:mount.lustre.0 Request processed in 93us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853694.899302:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787853694.899494:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152162432:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853694.899506:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927821c6400/0xcf1365f7cb0558a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0558a9 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853694.899515:0:14395:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927821c6400/0xcf1365f7cb0558a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0558a9 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853694.899534:0:14395:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787853694.899898:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c6400/0xcf1365f7cb0558a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0558a9 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853694.899906:0:14395:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9927821c6400/0xcf1365f7cb0558a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0558a9 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853694.899913:0:14395:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787853694.899917:0:14395:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787853694.899923:0:14395:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff992641d72000 10000000:01000000:3.0:1787853694.899925:0:14395:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787853694.899929:0:14395:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787853694.899931:0:14395:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787853694.899950:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb0558b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853694.899957:0:14395:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb0558b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853694.899965:0:14395:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb0558b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853694.899979:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152162560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787853694.900010:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853694.900041:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274586fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853694.900098:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152162560 00000100:00100000:2.0:1787853694.900103:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152162560 00000100:00100000:2.0:1787853694.900137:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787853694.900145:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dca9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+7:14395:x1874700152162560:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787853694.900153:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853694.900162:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992747f70a00/0xcf1365f7cb0558b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0558b0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853694.900177:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992747f70a00/0xcf1365f7cb0558b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0558b0 expref: 8 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853694.900185:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992747f70a00/0xcf1365f7cb0558b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0558b0 expref: 8 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853694.900191:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70a00, rc 0) 00000100:00100000:2.0:1787853694.900273:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dca9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+8:14395:x1874700152162560:12345-0@lo:101:mount.lustre.0 Request processed in 129us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853694.900278:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787853694.903971:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522c780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152162560:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787853694.903999:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb0558b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0558b7 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853694.904011:0:14395:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb0558b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0558b7 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853694.904094:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748346d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152162688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853694.904153:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853694.904203:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927443ed3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787853694.904585:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152162688 00000100:00100000:2.0:1787853694.904592:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152162688 00000100:00100000:2.0:1787853694.904639:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787853694.904647:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+8:14395:x1874700152162688:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853694.905303:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+9:14395:x1874700152162688:12345-0@lo:501:mount.lustre.0 Request processed in 655us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853694.905311:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787853694.905498:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748346d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152162688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853694.905535:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748346d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152162816:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787853694.905576:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853694.905608:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927443ed3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853694.905862:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152162816 00000100:00100000:3.0:1787853694.905868:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152162816 00000100:00100000:3.0:1787853694.905895:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787853694.905909:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dcaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+9:14395:x1874700152162816:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853694.906238:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dcaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+9:14395:x1874700152162816:12345-0@lo:503:mount.lustre.0 Request processed in 329us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853694.906244:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787853694.906464:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748346d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152162816:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787853694.907032:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9926421070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14431:1874700152162944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853694.907270:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853694.907456:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff992746bfa180 going to sleep for 11 seconds 00000100:00100000:1.0:1787853694.907490:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152162944 00000100:00100000:1.0:1787853694.907496:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152162944 00000100:00100000:1.0:1787853694.907564:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787853694.907573:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+9:14431:x1874700152162944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787853694.907904:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+9:14431:x1874700152162944:12345-0@lo:502:llog_process_th.0 Request processed in 332us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853694.907917:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787853694.908291:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9926421070c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14431:1874700152162944:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787853694.908333:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787853694.908344:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853694.908346:0:14431:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787853694.908353:0:14431:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787853694.908356:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787853694.908369:0:14431:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9927756ecd70) 00000020:00000080:2.0:1787853694.908385:0:14431:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787853694.908390:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787853694.908465:0:14431:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787853694.908472:0:14431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf1365f7cb0558c5 00000020:00000080:2.0:1787853694.908706:0:14431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787853694.908710:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853694.908714:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853694.908715:0:14431:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787853694.908718:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787853694.908722:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853694.908723:0:14431:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787853694.908726:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787853694.908738:0:14431:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9927756eb3a0) 00000020:00000080:2.0:1787853694.908747:0:14431:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787853694.908751:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787853694.908753:0:14431:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787853694.908756:0:14431:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787853694.908761:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787853694.908812:0:14431:0:(tgt_mount.c:153:server_get_mount()) get mount ffff992641d72000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787853694.908825:0:14431:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9927756e99d0) 00000020:00000080:2.0:1787853694.908832:0:14431:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787853694.908876:0:14431:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787853694.908880:0:14431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf1365f7cb0558da 00000020:00000080:2.0:1787853694.908962:0:14431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787853694.908968:0:14431:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787853694.908971:0:14431:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcf1365f7cb0558e1 00080000:01000000:2.0:1787853694.908975:0:14431:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787853694.908978:0:14431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf1365f7cb0558e8 00010000:00010000:3.0:1787853695.006968:0:14431:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787853695.007571:0:14431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1787853695.007785:0:14431:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787853695.008606:0:14431:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9927500d99d0) 00000020:00000080:3.0:1787853695.008623:0:14431:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787853695.008778:0:14431:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787853695.008785:0:14431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf1365f7cb0558f6 00000020:00000080:2.0:1787853695.014140:0:14431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787853695.020931:0:14431:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcf1365f7cb0558fd 00000020:00000080:2.0:1787853695.021900:0:14431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787853695.021911:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853695.021917:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853695.021920:0:14431:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787853695.021923:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787853695.021926:0:14431:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1787853695.021927:0:14431:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787853695.021929:0:14431:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787853695.021930:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787853695.021933:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853695.021934:0:14431:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787853695.021936:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787853695.021941:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853695.021943:0:14431:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787853695.021946:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787853695.021983:0:14431:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787853695.022006:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787853695.022014:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853695.022016:0:14431:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787853695.022019:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787853695.022022:0:14431:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787853695.022026:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787853695.022027:0:14431:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787853695.022030:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787853695.022035:0:14431:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.110@tcp to nid 0x20000c0a8ce6e (192.168.206.110@tcp) 00000020:01000000:2.0:1787853695.022059:0:14431:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787853695.022061:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787853695.022076:0:14431:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9927756e8000) 00000020:00000080:2.0:1787853695.022089:0:14431:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787853695.022093:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787853695.022140:0:14431:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787853695.022146:0:14431:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787853695.022152:0:14431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf1365f7cb05590b 00010000:00080000:2.0:1787853695.022182:0:14431:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9927756f5000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.110@tcp at head 00010000:00010000:2.0:1787853695.022923:0:14431:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1787853695.023271:0:14431:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787853695.023318:0:14431:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787853695.027066:0:14431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787853695.027158:0:14431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787853695.027235:0:14431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787853695.027953:0:14435:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787853695.027958:0:14435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787853695.028616:0:14431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787853695.028627:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787853695.028657:0:14431:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787853695.028704:0:14431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf1365f7cb055912 00000100:00080000:1.0:1787853695.028714:0:14431:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787853695.028719:0:14431:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9927756f5000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:1.0:1787853695.028753:0:14431:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff992748346d00 x1874700152163072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787853695.028786:0:14431:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787853695.028849:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853695.028853:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853695.028855:0:14431:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787853695.028859:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787853695.028862:0:14431:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1787853695.028863:0:14431:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787853695.028865:0:14431:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787853695.028866:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787853695.028869:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853695.028870:0:14431:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787853695.028873:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787853695.028876:0:14431:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787853695.028879:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853695.028880:0:14431:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787853695.028883:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787853695.028887:0:14431:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.110@tcp to nid 0x20000c0a8ce6e (192.168.206.110@tcp) 00000020:01000000:1.0:1787853695.028906:0:14431:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787853695.028909:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787853695.028919:0:14431:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99276e824d70) 00000020:00000080:1.0:1787853695.028929:0:14431:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787853695.028942:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787853695.028993:0:14431:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787853695.028997:0:14431:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787853695.029003:0:14431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf1365f7cb055920 00010000:00080000:1.0:1787853695.029038:0:14431:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99277bee5000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.110@tcp at head 00010000:00010000:1.0:1787853695.029225:0:14431:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1787853695.029490:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748346d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1874700152163072:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787853695.029548:0:3296:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874700152163072 offset 0 length 520: 4 00000040:01000000:1.0:1787853695.029874:0:14431:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787853695.029898:0:14431:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787853695.030815:0:14431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787853695.030886:0:14431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787853695.030958:0:14431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787853695.031486:0:14437:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787853695.031490:0:14437:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787853695.032580:0:14431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787853695.032592:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787853695.032621:0:14431:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787853695.032638:0:14431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf1365f7cb055927 00000100:00080000:1.0:1787853695.032647:0:14431:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787853695.032652:0:14431:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99277bee5000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:1.0:1787853695.032837:0:14431:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9927483461c0 x1874700152163200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787853695.032891:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927483461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1874700152163200:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787853695.032944:0:3296:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874700152163200 offset 0 length 520: 4 00000100:00080000:1.0:1787853695.032996:0:14431:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787853695.033057:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853695.033062:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853695.033064:0:14431:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787853695.033067:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853695.033072:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853695.033073:0:14431:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787853695.033076:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787853695.033078:0:14431:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787853695.033080:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853695.033083:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853695.033084:0:14431:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787853695.033096:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853695.033099:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853695.033101:0:14431:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787853695.033105:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787853695.033133:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927483443c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14431:1874700152163328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787853695.033184:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853695.033201:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927443ed000 going to sleep for 11 seconds 00000100:00100000:0.0:1787853695.033296:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152163328 00000100:00100000:0.0:1787853695.033303:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152163328 00000100:00100000:0.0:1787853695.033350:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787853695.033359:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+9:14431:x1874700152163328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853695.033807:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+9:14431:x1874700152163328:12345-0@lo:502:llog_process_th.0 Request processed in 448us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853695.033821:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787853695.033928:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927483443c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14431:1874700152163328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787853695.033958:0:14431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853695.033963:0:14431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853695.033964:0:14431:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787853695.033970:0:14431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787853695.034149:0:14395:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787853695.034165:0:14395:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787853695.034186:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb0558b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0558b7 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.034196:0:14395:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9927821c7a00/0xcf1365f7cb0558b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0558b7 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853695.034203:0:14395:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff992641d72000 from 1 10000000:01000000:0.0:1787853695.034206:0:14395:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787853695.034230:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05592e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.034238:0:14395:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05592e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.034246:0:14395:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05592e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853695.034258:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152163456:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787853695.034286:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853695.034316:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff992744e88900 going to sleep for 11 seconds 00000100:00100000:3.0:1787853695.034459:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152163456 00000100:00100000:3.0:1787853695.034464:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152163456 00000100:00100000:3.0:1787853695.034488:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787853695.034495:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dcaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+9:14395:x1874700152163456:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853695.034505:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853695.034518:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927821c7c00/0xcf1365f7cb055935 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb05592e expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853695.034548:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927821c7c00/0xcf1365f7cb055935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb05592e expref: 10 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853695.034557:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927821c7c00/0xcf1365f7cb055935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05592e expref: 10 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853695.034565:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927821c7c00, rc 0) 00000100:00100000:3.0:1787853695.035237:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dcaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+10:14395:x1874700152163456:12345-0@lo:101:mount.lustre.0 Request processed in 739us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853695.035245:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787853695.035483:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152163456:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853695.035499:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05592e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055935 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.035509:0:14395:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05592e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb055935 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853695.036151:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152163584:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787853695.036200:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853695.036271:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff992744e88900 going to sleep for 11 seconds 00000100:00100000:2.0:1787853695.036319:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152163584 00000100:00100000:2.0:1787853695.036456:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152163584 00000100:00100000:2.0:1787853695.036532:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787853695.036541:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dca8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+10:14395:x1874700152163584:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787853695.036558:0:14405:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787853695.036564:0:14405:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787853695.036645:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dca8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+10:14395:x1874700152163584:12345-0@lo:256:mount.lustre.0 Request processed in 105us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853695.036651:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787853695.036725:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152163584:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787853695.037314:0:14395:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787853695.037344:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05592e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055935 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.037356:0:14395:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05592e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055935 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853695.037371:0:14395:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff992641d72000 from 1 10000000:01000000:0.0:1787853695.037374:0:14395:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787853695.037399:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb05593c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.037407:0:14395:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb05593c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.037416:0:14395:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb05593c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853695.037430:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152163712:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787853695.037463:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853695.037902:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff992744e88900 going to sleep for 11 seconds 00000100:00100000:3.0:1787853695.037978:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152163712 00000100:00100000:3.0:1787853695.037984:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152163712 00000100:00100000:3.0:1787853695.038013:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787853695.038021:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dcab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+10:14395:x1874700152163712:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853695.038032:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853695.038044:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055943 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb05593c expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853695.038064:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb05593c expref: 11 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853695.038076:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05593c expref: 11 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853695.038084:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927821c6800, rc 0) 00000100:00100000:3.0:1787853695.038170:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dcab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+11:14395:x1874700152163712:12345-0@lo:101:mount.lustre.0 Request processed in 149us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853695.038177:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787853695.038263:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152163712:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853695.038283:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb05593c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055943 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.038292:0:14395:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb05593c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb055943 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853695.038350:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152163840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853695.038520:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853695.038542:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff992744e88900 going to sleep for 11 seconds 00000100:00100000:3.0:1787853695.038591:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152163840 00000100:00100000:3.0:1787853695.038596:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152163840 00000100:00100000:3.0:1787853695.038623:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787853695.038629:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dcab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+11:14395:x1874700152163840:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853695.038988:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dcab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+11:14395:x1874700152163840:12345-0@lo:501:mount.lustre.0 Request processed in 358us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853695.038995:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787853695.039111:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152163840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853695.039142:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152163968:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787853695.039179:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853695.039206:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff992744e88900 going to sleep for 11 seconds 00000100:00100000:3.0:1787853695.039252:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152163968 00000100:00100000:3.0:1787853695.039257:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152163968 00000100:00100000:3.0:1787853695.039284:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787853695.039290:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dcaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+11:14395:x1874700152163968:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853695.039616:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dcaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+11:14395:x1874700152163968:12345-0@lo:503:mount.lustre.0 Request processed in 324us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853695.039624:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787853695.039915:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152163968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853695.040231:0:14439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14439:1874700152164096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787853695.040270:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853695.040338:0:14439:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d54ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853695.040477:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152164096 00000100:00100000:2.0:1787853695.040483:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152164096 00000100:00100000:2.0:1787853695.040546:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787853695.040555:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+11:14439:x1874700152164096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853695.040860:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+11:14439:x1874700152164096:12345-0@lo:502:llog_process_th.0 Request processed in 305us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853695.040866:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787853695.040952:0:14439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14439:1874700152164096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787853695.040974:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853695.040982:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853695.040984:0:14439:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787853695.040990:0:14439:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff992641d72000 00000020:00000080:0.0:1787853695.040992:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787853695.041000:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853695.041002:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853695.041003:0:14439:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787853695.041005:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853695.041007:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853695.041009:0:14439:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787853695.041012:0:14439:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff992641d72000 00000020:00000080:0.0:1787853695.041018:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787853695.041107:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853695.041111:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853695.041112:0:14439:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787853695.041115:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853695.041117:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853695.041118:0:14439:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787853695.041121:0:14439:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff992641d72000 00000020:00000080:0.0:1787853695.041123:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787853695.042531:0:14439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14439:1874700152164224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853695.042592:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853695.043057:0:14439:0:(client.c:2715:ptlrpc_set_wait()) set ffff992742ce4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787853695.044659:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152164224 00000100:00100000:3.0:1787853695.044683:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152164224 00000100:00100000:3.0:1787853695.044735:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787853695.044745:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+11:14439:x1874700152164224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787853695.044975:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+11:14439:x1874700152164224:12345-0@lo:502:llog_process_th.0 Request processed in 232us (2382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853695.044983:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787853695.045097:0:14439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14439:1874700152164224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787853695.045127:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853695.045135:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853695.045137:0:14439:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787853695.045143:0:14439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787853695.045202:0:14395:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787853695.045218:0:14395:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787853695.045240:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb05593c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055943 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.045251:0:14395:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb05593c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055943 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853695.045288:0:14395:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787853695.045291:0:14395:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff992641d72000 10000000:01000000:0.0:1787853695.045294:0:14395:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff992641d72000 10000000:01000000:0.0:1787853695.045298:0:14395:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787853695.045303:0:14395:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff992641d72000 from 1 10000000:01000000:0.0:1787853695.045311:0:14395:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787853695.045348:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927587a9800/0xcf1365f7cb05594a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.045358:0:14395:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9927587a9800/0xcf1365f7cb05594a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.045446:0:14395:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927587a9800/0xcf1365f7cb05594a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853695.045466:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152164352:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787853695.045500:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853695.051796:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff992742ce4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787853695.051965:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152164352 00000100:00100000:0.0:1787853695.051974:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152164352 00000100:00100000:0.0:1787853695.053428:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787853695.053444:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+11:14395:x1874700152164352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853695.053460:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853695.053476:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927587a9200/0xcf1365f7cb055951 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb05594a expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.053503:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927587a9200/0xcf1365f7cb055951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb05594a expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.053513:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927587a9200/0xcf1365f7cb055951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05594a expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.053521:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a9200, rc 0) 00000100:00100000:0.0:1787853695.053596:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:14395:x1874700152164352:12345-0@lo:101:mount.lustre.0 Request processed in 157us (8095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853695.053613:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787853695.054136:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152164352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853695.054153:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927587a9800/0xcf1365f7cb05594a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055951 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853695.054170:0:14395:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927587a9800/0xcf1365f7cb05594a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb055951 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853695.054234:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152164480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853695.054269:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853695.054883:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d54ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787853695.057966:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152164480 00000100:00100000:1.0:1787853695.057977:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152164480 00000100:00100000:1.0:1787853695.058017:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787853695.058026:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:14395:x1874700152164480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853695.058343:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:14395:x1874700152164480:12345-0@lo:501:mount.lustre.0 Request processed in 317us (4072us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853695.058351:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787853695.059578:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152164480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853695.059628:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152164608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853695.059703:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853695.059734:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d54ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787853695.060515:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152164608 00000100:00100000:1.0:1787853695.060522:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152164608 00000100:00100000:1.0:1787853695.060562:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787853695.060571:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:14395:x1874700152164608:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787853695.060762:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:14395:x1874700152164608:12345-0@lo:503:mount.lustre.0 Request processed in 192us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853695.060801:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787853695.062784:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152164608:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787853695.064583:0:14444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748347480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14444:1874700152164736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787853695.072137:0:14444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853695.072188:0:14444:0:(client.c:2715:ptlrpc_set_wait()) set ffff992742db5900 going to sleep for 11 seconds 00000100:00100000:3.0:1787853695.072244:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152164736 00000100:00100000:3.0:1787853695.072252:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152164736 00000100:00100000:3.0:1787853695.072302:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787853695.072310:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:14444:x1874700152164736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787853695.072952:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:14444:x1874700152164736:12345-0@lo:502:llog_process_th.0 Request processed in 641us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853695.072962:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787853695.076525:0:14444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748347480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14444:1874700152164736:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787853695.076598:0:14444:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787853695.076613:0:14444:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99276e8219d0) 00000020:00000080:1.0:1787853695.076639:0:14444:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1787853695.076889:0:14444:0:(tgt_mount.c:153:server_get_mount()) get mount ffff992641d72000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787853695.076893:0:14444:0:(tgt_mount.c:187:server_put_mount()) put mount ffff992641d72000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787853695.076896:0:14444:0:(obd_mount.c:710:lustre_put_lsi()) put ffff992641d72000 4 00010000:00080000:1.0:1787853695.076921:0:14444:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99277c198800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.110@tcp at head 00010000:00010000:1.0:1787853695.083629:0:14444:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1787853695.083854:0:14444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787853695.083889:0:14444:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787853695.083901:0:14444:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcf1365f7cb05595f 00000100:00080000:1.0:1787853695.083910:0:14444:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787853695.083916:0:14444:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99277c198800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:1.0:1787853695.083948:0:14444:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff992748347480 x1874700152164864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787853695.083969:0:14444:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787853695.084836:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874700152164864:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787853695.084899:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853695.090558:0:14444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14444:1874700152164992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787853695.090641:0:14444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853695.090705:0:14444:0:(client.c:2715:ptlrpc_set_wait()) set ffff992742ce4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787853695.092950:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152164992 00000100:00100000:2.0:1787853695.092960:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152164992 00000100:00100000:2.0:1787853695.093012:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787853695.093021:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:14444:x1874700152164992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787853695.093263:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:14444:x1874700152164992:12345-0@lo:502:llog_process_th.0 Request processed in 242us (2621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853695.093270:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787853695.094108:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152164864 00000100:00100000:3.0:1787853695.094115:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152164864 00000100:00100000:3.0:1787853695.094139:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853695.094146:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9926421070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3296:x1874700152164864:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787853695.094202:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9926421070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3296:x1874700152164864:12345-0@lo:38:llog_process_th.0 Request processed in 56us (9303us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787853695.094218:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787853695.094322:0:14444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14444:1874700152164992:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787853695.094384:0:14444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787853695.094756:0:14395:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787853695.094788:0:14395:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787853695.094805:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927587a9800/0xcf1365f7cb05594a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055951 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853695.094815:0:14395:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9927587a9800/0xcf1365f7cb05594a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055951 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787853695.094862:0:14395:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787853695.094865:0:14395:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787853695.094866:0:14395:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787853695.094867:0:14395:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787853695.094868:0:14395:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787853695.094870:0:14395:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787853695.094871:0:14395:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787853695.094873:0:14395:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787853695.094875:0:14395:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787853695.094876:0:14395:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787853695.094879:0:14395:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787853695.094882:0:14395:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787853695.094883:0:14395:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787853695.094884:0:14395:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787853695.094885:0:14395:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787853695.094886:0:14395:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787853695.094887:0:14395:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787853695.094888:0:14395:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787853695.094889:0:14395:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787853695.094891:0:14395:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787853695.094892:0:14395:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787853695.094911:0:14395:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787853695.094927:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152165120:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787853695.094978:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853695.095008:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d54e600 going to sleep for 11 seconds 00000100:00100000:3.0:1787853695.095030:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152165120 00000100:00100000:3.0:1787853695.095034:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152165120 00000100:00100000:3.0:1787853695.095059:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787853695.095066:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:14395:x1874700152165120:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787853695.095086:0:14407:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787853695.095097:0:14407:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787853695.096126:0:3296:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787853695.096137:0:3296:0:(import.c:65:import_set_state_nolock()) ffff99277c198800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787853695.096142:0:3296:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787853695.096154:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874700152164864:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1787853695.138972:0:14407:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787853695.138994:0:14407:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787853695.139056:0:14429:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787853695.139060:0:14429:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787853695.139083:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff992766197a00/0xcf1365f7cb055966 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853695.139100:0:14429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9927821c7c00/0xcf1365f7cb055935 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05592e expref: 12 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853695.139108:0:14429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff992766197a00/0xcf1365f7cb055966 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853695.139145:0:14429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9927821c7c00/0xcf1365f7cb055935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb05592e expref: 12 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853695.139159:0:14429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9927821c7c00/0xcf1365f7cb055935 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb05592e expref: 12 pid: 14408 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853695.139189:0:14429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748347c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14429:1874700152165248:0@lo:104: 00000100:00100000:1.0:1787853695.139244:0:14429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853695.139282:0:14429:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276ad4cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787853695.140731:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152165248 00000100:00100000:0.0:1787853695.140742:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152165248 00000100:00100000:0.0:1787853695.140792:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787853695.140801:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748344780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+3:14429:x1874700152165248:12345-0@lo:104: 00010000:00010000:0.0:1787853695.140815:0:14396:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05592e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb055935 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.140892:0:14396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787853695.140898:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748344780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+3:14429:x1874700152165248:12345-0@lo:104: Request processed in 99us (1654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853695.140905:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787853695.140926:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853695.140931:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05592e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb055935 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.140938:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8a00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:0.0:1787853695.140942:0:14402:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05592e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb055935 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.140950:0:14402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05592e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb055935 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853695.140973:0:14402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05592e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb055935 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853695.140979:0:14402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787853695.141010:0:14402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05592e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb055935 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.141017:0:14402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853695.141035:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05592e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb055935 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.141042:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05592e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb055935 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.141059:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853695.141061:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853695.141062:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853695.141090:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3297:1874700152165376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853695.141123:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853695.141184:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152165376 00000100:00100000:0.0:1787853695.141188:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152165376 00010000:00010000:0.0:1787853695.141205:0:14398:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9927821c7c00/0xcf1365f7cb055935 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb05592e expref: 13 pid: 14408 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853695.141225:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787853695.141232:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+13:3297:x1874700152165376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853695.141243:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853695.141248:0:14398:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9927821c7c00/0xcf1365f7cb055935 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb05592e expref: 13 pid: 14408 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.141264:0:14398:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9927821c7c00/0xcf1365f7cb055935 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb05592e expref: 13 pid: 14408 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.141281:0:14398:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff992766197a00/0xcf1365f7cb055966 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.141289:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992766197a00/0xcf1365f7cb055966 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787853695.141302:0:14398:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002242512s 00010000:00010000:0.0:1787853695.141307:0:14398:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff992766197a00/0xcf1365f7cb055966 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.141314:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff992766197a00/0xcf1365f7cb055966 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.141321:0:14398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff992766197a00/0xcf1365f7cb055966 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.141338:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff992766197a00/0xcf1365f7cb055966 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.141343:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197a00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853695.141347:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff992766197a00/0xcf1365f7cb055966 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.141353:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff992766197a00/0xcf1365f7cb055966 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853695.141531:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927821c7c00/0xcf1365f7cb055935 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb05592e expref: 13 pid: 14408 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853695.141543:0:14429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748347c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14429:1874700152165248:0@lo:104: 00010000:00010000:2.0:1787853695.141560:0:14429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff992766197a00/0xcf1365f7cb055966 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853695.141568:0:14429:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff992766197a00/0xcf1365f7cb055966 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853695.141574:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff992766197a00/0xcf1365f7cb055966 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.141665:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff992766197a00/0xcf1365f7cb055966 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.141889:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992766197a00/0xcf1365f7cb055966 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853695.141904:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853695.141983:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:3297:x1874700152165376:12345-0@lo:103:ldlm_bl.0 Request processed in 750us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853695.141991:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787853695.142541:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3297:1874700152165376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787853695.150984:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+11:14395:x1874700152165120:12345-0@lo:253:mount.lustre.0 Request processed in 55910us (55997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853695.150998:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787853695.151083:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14395:1874700152165120:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787853695.151098:0:14395:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787853695.151100:0:14395:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787853695.151102:0:14395:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787853695.151104:0:14395:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853695.151105:0:14395:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853695.151106:0:14395:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853695.151108:0:14395:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853695.151109:0:14395:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787853695.151111:0:14395:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787853695.151113:0:14395:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853695.151114:0:14395:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787853695.151130:0:14395:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787853695.157503:0:14395:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787853695.157701:0:14395:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787853695.158054:0:14395:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787853695.158217:0:14395:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787853695.158621:0:14395:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787853695.158957:0:14395:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787853695.160062:0:14395:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787853695.160208:0:14395:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787853695.160544:0:14395:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787853695.162153:0:14395:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787853695.162485:0:14395:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787853695.162631:0:14395:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1787853695.184286:0:14395:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1787853695.185223:0:14395:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787853695.185347:0:14450:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1787853695.185351:0:14450:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1787853695.185621:0:14452:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1787853695.185724:0:14452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787853695.191165:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787853695.191237:0:14452:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787853695.191241:0:14452:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1787853695.191548:0:14395:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787853695.191735:0:14395:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787853695.192555:0:14395:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787853695.192566:0:14395:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787853695.192855:0:14395:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787853695.194163:0:14395:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787853695.195961:0:14395:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787853695.196027:0:14395:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1787853695.198139:0:14395:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1787853695.204195:0:14395:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787853695.237143:0:14395:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787853695.237175:0:14395:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffad8d81d87988 00100000:10000000:1.0:1787853695.237184:0:14395:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787853695.238085:0:14395:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787853695.238098:0:14395:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.110@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787853695.238110:0:14395:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787853695.238132:0:14395:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1787853695.814396:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787853696.140383:0:14445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787853696.709772:0:14410:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787853696.709779:0:14410:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff992641d72000 from 6 10000000:01000000:0.0:1787853696.709783:0:14410:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787853696.709825:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05596d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853696.709849:0:14410:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05596d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853696.709861:0:14410:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05596d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853696.709885:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152165504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787853696.709948:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853696.709991:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff992746bd1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787853696.710013:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152165504 00000100:00100000:0.0:1787853696.710018:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152165504 00000100:00100000:0.0:1787853696.710061:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787853696.710069:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+11:14410:x1874700152165504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853696.710081:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853696.710093:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927587a9c00/0xcf1365f7cb055974 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb05596d expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853696.710114:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927587a9c00/0xcf1365f7cb055974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb05596d expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853696.710124:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927587a9c00/0xcf1365f7cb055974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05596d expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853696.710133:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a9c00, rc 0) 00000100:00100000:0.0:1787853696.710170:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:14410:x1874700152165504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853696.710177:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787853696.710232:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152165504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853696.710246:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05596d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055974 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853696.710254:0:14410:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05596d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb055974 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853696.710299:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152165632:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787853696.710326:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853696.710341:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff992746bd1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787853696.712102:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152165632 00000100:00100000:3.0:1787853696.712113:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152165632 00000100:00100000:3.0:1787853696.712153:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787853696.712162:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:14410:x1874700152165632:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787853696.712183:0:14407:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787853696.712199:0:14407:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787853696.712203:0:14407:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787853696.712318:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:14410:x1874700152165632:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 156us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853696.712325:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787853696.712513:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152165632:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787853696.712556:0:14410:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787853696.712565:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05596d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055974 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853696.712585:0:14410:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05596d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055974 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853696.838875:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787853697.158313:0:14445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787853697.866513:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853698.887868:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787853699.466724:0:14695:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787853699.910125:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787853700.421848:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853700.421855:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787853700.421857:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853700.421866:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787853700.421869:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787853700.421872:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787853700.421876:0:38:0:(import.c:65:import_set_state_nolock()) ffff99277c198800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1787853700.421885:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1787853700.421887:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99277c198800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:1.0:1787853700.421902:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3297:1874700152165760:0@lo:400:kworker.0 00000100:00100000:3.0:1787853700.421909:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99277522fc00 x1874700152165888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787853700.421966:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853700.421997:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874700152165888:0@lo:38:kworker.0 00000100:00100000:3.0:1787853700.422031:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853700.422127:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152165888 00000100:00100000:1.0:1787853700.422135:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152165888 00000100:00100000:1.0:1787853700.422170:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787853700.422177:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3296:x1874700152165888:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787853700.422198:0:14415:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 394 last 0 00000020:00000080:1.0:1787853700.422229:0:14415:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcf1365f7cb05597b 00000004:00100000:1.0:1787853700.422241:0:14415:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1787853700.422271:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152165760 00000100:00100000:0.0:1787853700.422275:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152165760 00000100:00080000:1.0:1787853700.422352:0:14415:0:(import.c:65:import_set_state_nolock()) ffff99277c199800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787853700.422393:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1874700152165888:12345-0@lo:38:kworker.0 Request processed in 215us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853700.422396:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787853700.422400:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787853700.422403:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:3297:x1874700152165760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853700.422449:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:3297:x1874700152165760:12345-0@lo:400:kworker.0 Request processed in 46us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853700.422455:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787853700.422503:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3297:1874700152165760:0@lo:400:kworker.0 00010000:00080000:3.0:1787853700.422554:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99277522fc00 x1874700152165888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787853710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787853700.422566:0:3296:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787853700.422573:0:3296:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787853700.422577:0:3296:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787853700.422579:0:3296:0:(import.c:65:import_set_state_nolock()) ffff99277c198800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787853700.422584:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3296:1874700152165888:0@lo:38:kworker.0 00010000:00010000:2.0:1787853700.938134:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853701.960951:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787853702.074371:0:14845:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd93320a90 20000000:00000080:2.0:1787853702.074387:0:14845:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9927764b0400 uarg=0000000000000000 20000000:01000000:2.0:1787853702.074428:0:14845:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787853702.074435:0:14845:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787853702.074439:0:14845:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787853702.079944:0:14846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787853702.080250:0:14845:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787853702.090955:0:14845:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787853702.091221:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9927821c7800/0xcf1365f7cb055982 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853702.091240:0:14845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055943 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05593c expref: 11 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853702.091248:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9927821c7800/0xcf1365f7cb055982 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853702.091287:0:14845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb05593c expref: 11 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853702.091310:0:14845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055943 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb05593c expref: 11 pid: 14408 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853702.091324:0:14845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14845:1874700152166016:0@lo:104: 00000100:00100000:3.0:1787853702.091385:0:14845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853702.091472:0:14845:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d550300 going to sleep for 11 seconds 00000100:00100000:1.0:1787853702.091536:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152166016 00000100:00100000:1.0:1787853702.091543:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152166016 00000100:00100000:1.0:1787853702.091622:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787853702.091632:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+3:14845:x1874700152166016:12345-0@lo:104: 00010000:00010000:1.0:1787853702.091644:0:14397:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb05593c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb055943 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853702.091858:0:14397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787853702.091865:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+3:14845:x1874700152166016:12345-0@lo:104: Request processed in 235us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853702.091872:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787853702.091924:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853702.091930:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb05593c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb055943 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853702.091938:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a9400 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:0.0:1787853702.091941:0:14402:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb05593c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb055943 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853702.091960:0:14402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb05593c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb055943 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853702.091968:0:14402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb05593c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb055943 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853702.091973:0:14402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787853702.092013:0:14402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb05593c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb055943 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853702.092019:0:14402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853702.092037:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb05593c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb055943 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853702.092043:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb05593c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb055943 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853702.092058:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853702.092060:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853702.092061:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853702.092085:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3299:1874700152166144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853702.092114:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853702.094425:0:14845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14845:1874700152166016:0@lo:104: 00010000:00010000:3.0:1787853702.094450:0:14845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9927821c7800/0xcf1365f7cb055982 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853702.095410:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152166144 00000100:00100000:1.0:1787853702.095419:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152166144 00010000:00010000:1.0:1787853702.095447:0:14399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055943 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb05593c expref: 12 pid: 14408 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853702.095511:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787853702.095519:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:3299:x1874700152166144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787853702.095532:0:14399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853702.095537:0:14399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055943 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb05593c expref: 12 pid: 14408 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853702.095548:0:14399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb05593c expref: 12 pid: 14408 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853702.095564:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055943 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb05593c expref: 12 pid: 14408 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853702.095576:0:14399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9927821c7800/0xcf1365f7cb055982 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853702.095583:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927821c7800/0xcf1365f7cb055982 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853702.095596:0:14399:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9927821c7800/0xcf1365f7cb055982 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853702.095615:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9927821c7800/0xcf1365f7cb055982 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853702.095622:0:14399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9927821c7800/0xcf1365f7cb055982 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853702.095629:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9927821c7800/0xcf1365f7cb055982 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853702.095634:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c7800 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:1.0:1787853702.095638:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9927821c7800/0xcf1365f7cb055982 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853702.095646:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9927821c7800/0xcf1365f7cb055982 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853702.095661:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9927821c7800/0xcf1365f7cb055982 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853702.095702:0:14399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853702.095776:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+11:3299:x1874700152166144:12345-0@lo:103:ldlm_bl.0 Request processed in 258us (3660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853702.095784:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787853702.095859:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3299:1874700152166144:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787853702.096020:0:14845:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9927821c7800/0xcf1365f7cb055982 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853702.096028:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9927821c7800/0xcf1365f7cb055982 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853702.096034:0:14845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927821c7800/0xcf1365f7cb055982 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853702.982633:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787853703.686821:0:14410:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787853703.686829:0:14410:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff992641d72000 from 10 10000000:01000000:0.0:1787853703.686834:0:14410:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787853703.686880:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb055989 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853703.686892:0:14410:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb055989 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853703.686919:0:14410:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb055989 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853703.686947:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152166272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787853703.687021:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853703.687080:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274607d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787853703.688545:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152166272 00000100:00100000:1.0:1787853703.688561:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152166272 00000100:00100000:1.0:1787853703.688619:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787853703.688629:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+11:14410:x1874700152166272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787853703.688653:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853703.688696:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992766196400/0xcf1365f7cb055990 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb055989 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853703.688752:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992766196400/0xcf1365f7cb055990 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb055989 expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853703.688766:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992766196400/0xcf1365f7cb055990 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb055989 expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853703.688777:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196400, rc 0) 00000100:00100000:1.0:1787853703.688880:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:14410:x1874700152166272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 251us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853703.688890:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787853703.690523:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152166272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853703.690551:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb055989 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055990 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853703.690563:0:14410:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb055989 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb055990 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853703.690644:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642105680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152166400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853703.690955:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853703.691076:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c218000 going to sleep for 11 seconds 00000100:00100000:0.0:1787853703.695925:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152166400 00000100:00100000:0.0:1787853703.695939:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152166400 00000100:00100000:0.0:1787853703.696042:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787853703.696053:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:14410:x1874700152166400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787853703.697866:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:14410:x1874700152166400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1809us (6905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853703.697879:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787853703.699653:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642105680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152166400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853703.700473:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642105680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152166528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853703.700550:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853703.700598:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277c218000 going to sleep for 11 seconds 00000100:00100000:1.0:1787853703.700621:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152166528 00000100:00100000:1.0:1787853703.700636:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152166528 00000100:00100000:1.0:1787853703.700735:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787853703.700747:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:14410:x1874700152166528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853703.701198:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:14410:x1874700152166528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 452us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853703.701208:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787853703.702141:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642105680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152166528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787853703.707256:0:14917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787853703.707452:0:14410:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787853703.707478:0:14410:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787853703.707498:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb055989 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055990 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853703.707511:0:14410:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb055989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055990 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853704.006170:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853705.033129:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787853705.541895:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787853705.541903:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787853705.541906:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787853705.541909:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787853705.541951:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787853705.541970:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748346580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3299:1874700152166656:0@lo:400:kworker.0 00000100:00100000:3.0:1787853705.541971:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748346940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152166784:0@lo:400:kworker.0 00000100:00100000:0.0:1787853705.542263:0:3296:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853695/real 1787853695] req@ffff9927483461c0 x1874700152163200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853705 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853705.542981:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853705.543095:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152166784 00000100:00100000:2.0:1787853705.543106:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152166784 00000100:00100000:2.0:1787853705.543160:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787853705.543170:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152166784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853705.543238:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152166784:12345-0@lo:400:kworker.0 Request processed in 69us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853705.543246:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787853705.543292:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff992748346940 x1874700152166784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853705.543308:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748346940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152166784:0@lo:400:kworker.0 00000100:00100000:1.0:1787853705.545137:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853705.545159:0:3296:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9927483461c0 x1874700152163200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853705 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853705.545191:0:3296:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853695/real 1787853695] req@ffff992748346d00 x1874700152163072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853705 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853705.545210:0:3296:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff992748346d00 x1874700152163072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853705 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787853705.545246:0:3296:0:(import.c:65:import_set_state_nolock()) ffff99277bee5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787853705.545266:0:3296:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787853705.545270:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927483461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1874700152163200:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787853705.545276:0:3296:0:(import.c:65:import_set_state_nolock()) ffff9927756f5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787853705.545282:0:3296:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787853705.545285:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748346d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1874700152163072:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1787853705.545314:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152166656 00000100:00100000:2.0:1787853705.545324:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152166656 00000100:00100000:2.0:1787853705.545379:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787853705.545389:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:3299:x1874700152166656:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787853705.545397:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787853705.545401:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787853705.545405:0:37:0:(import.c:65:import_set_state_nolock()) ffff9927756f5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787853705.545409:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 389 00000100:00080000:1.0:1787853705.545414:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787853705.545420:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9927756f5000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:2.0:1787853705.545445:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:3299:x1874700152166656:12345-0@lo:400:kworker.0 Request processed in 58us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853705.545451:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff992748344f00 x1874700152166912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787853705.545453:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787853705.545467:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787853705.545470:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787853705.545472:0:37:0:(import.c:65:import_set_state_nolock()) ffff99277bee5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787853705.545474:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 389 00000100:00080000:1.0:1787853705.545477:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787853705.545480:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99277bee5000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:1.0:1787853705.545492:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9927483470c0 x1874700152167040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787853705.545526:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748346580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3299:1874700152166656:0@lo:400:kworker.0 00000100:00100000:0.0:1787853705.545983:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748344f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1874700152166912:0@lo:8:kworker.0 00000400:00000100:0.0:1787853705.546025:0:3296:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874700152166912 offset 0 length 520: 4 00000100:00100000:0.0:1787853705.546184:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927483470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1874700152167040:0@lo:8:kworker.0 00000400:00000100:0.0:1787853705.546210:0:3296:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874700152167040 offset 0 length 520: 4 00010000:00010000:0.0:1787853706.053865:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787853706.476252:0:15093:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787853706.476256:0:15093:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787853706.476437:0:15093:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff992758c39000 00000020:01000004:1.0:1787853706.476453:0:15093:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787853706.476465:0:15093:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787853706.476478:0:15093:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99276e8233a0) 00000020:00000080:1.0:1787853706.476493:0:15093:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787853706.521640:0:15093:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787853706.521927:0:15093:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787853706.525479:0:15093:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787853706.525953:0:15093:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787853706.526145:0:15093:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787853706.527641:0:15093:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 559: rc = 0 00100000:10000000:2.0:1787853706.527813:0:15093:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 559: rc = 0 00100000:10000000:2.0:1787853706.527933:0:15093:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 559: rc = 0 00100000:10000000:2.0:1787853706.529756:0:15093:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 220: rc = 0 00100000:10000000:2.0:1787853706.530043:0:15093:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 220: rc = 0 00100000:10000000:2.0:1787853706.530429:0:15093:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 220: rc = 0 00100000:10000000:2.0:1787853706.530717:0:15093:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 220: rc = 0 00100000:10000000:2.0:1787853706.530946:0:15093:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 220: rc = 0 00100000:10000000:2.0:1787853706.532127:0:15093:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 220: rc = 0 00000020:00000080:2.0:1787853706.533036:0:15093:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787853706.533047:0:15093:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787853706.533058:0:15093:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf1365f7cb05599e 00000020:01000004:2.0:1787853706.533066:0:15093:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787853706.533085:0:15093:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.110@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787853706.533089:0:15093:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787853706.533095:0:15093:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787853706.533100:0:15093:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787853706.533113:0:15093:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99274364b3a0) 00000020:00000080:2.0:1787853706.533122:0:15093:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787853706.538511:0:15093:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787853706.538693:0:15093:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787853706.538701:0:15093:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787853706.539640:0:15093:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787853706.539649:0:15093:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787853706.540824:0:15093:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787853706.540833:0:15093:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787853706.542065:0:15093:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787853706.542279:0:15093:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787853706.542286:0:15093:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787853706.550170:0:15093:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787853706.550183:0:15093:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787853706.589551:0:15093:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787853706.590873:0:15093:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787853706.590882:0:15093:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787853706.595190:0:15093:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787853706.595204:0:15093:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787853706.597866:0:15093:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787853706.597880:0:15093:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787853706.608899:0:15093:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787853706.609086:0:15093:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787853706.609092:0:15093:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787853706.615349:0:15093:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787853706.615366:0:15093:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787853706.690431:0:15093:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787853706.690619:0:15093:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787853706.690625:0:15093:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787853706.693154:0:15093:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787853706.693170:0:15093:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787853706.693596:0:15093:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787853706.693617:0:15093:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787853706.693623:0:15093:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.110@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787853706.709963:0:15093:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787853706.709999:0:15093:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.110@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787853706.710004:0:15093:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787853706.710005:0:15093:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787853706.710007:0:15093:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787853706.710008:0:15093:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787853706.710009:0:15093:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787853706.710010:0:15093:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787853706.710012:0:15093:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787853706.710013:0:15093:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787853706.710014:0:15093:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787853706.710017:0:15093:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787853706.710019:0:15093:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787853706.710020:0:15093:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787853706.710021:0:15093:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787853706.710022:0:15093:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787853706.710023:0:15093:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787853706.710024:0:15093:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787853706.710025:0:15093:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787853706.710026:0:15093:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787853706.710027:0:15093:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787853706.710066:0:15093:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787853706.710085:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152167168:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787853706.710152:0:15093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853706.710251:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274607ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787853706.712889:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152167168 00000100:00100000:2.0:1787853706.712902:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152167168 00000100:00100000:3.0:1787853706.714537:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787853706.714549:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:15093:x1874700152167168:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787853706.714584:0:14405:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787853706.714588:0:14405:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787853706.714592:0:14405:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787853706.718469:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:15093:x1874700152167168:12345-0@lo:253:mount.lustre.0 Request processed in 3914us (8308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853706.718483:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787853706.718577:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152167168:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787853706.718592:0:15093:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787853706.718595:0:15093:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787853706.718597:0:15093:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787853706.718598:0:15093:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787853706.718599:0:15093:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787853706.718600:0:15093:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787853706.718602:0:15093:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787853706.718603:0:15093:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787853706.718605:0:15093:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787853706.718606:0:15093:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787853706.718639:0:15093:0:(tgt_mount.c:101:server_register_mount()) register mount ffff992758c39000 from lustre-OST0000 10000000:01000000:3.0:1787853706.718727:0:15093:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787853706.718730:0:15093:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787853706.718736:0:15093:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99276e820000 local copy 00010000:00010000:3.0:1787853706.718745:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb055894 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05589b expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853706.718927:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152167296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853706.718959:0:15093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853706.718982:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274607ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853706.719217:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152167296 00000100:00100000:0.0:1787853706.719223:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152167296 00000100:00100000:0.0:1787853706.719267:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787853706.719276:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:15093:x1874700152167296:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853706.719425:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:15093:x1874700152167296:12345-0@lo:501:mount.lustre.0 Request processed in 149us (463us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787853706.719438:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787853706.719626:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152167296:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787853706.719640:0:15093:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787853706.720351:0:15093:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787853706.720360:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb055894 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05589b expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.720370:0:15093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb055894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05589b expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853706.720392:0:15093:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff992758c39000 10000000:01000000:0.0:1787853706.720396:0:15093:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787853706.720401:0:15093:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99276e820000 10000000:01000000:0.0:1787853706.720404:0:15093:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787853706.720407:0:15093:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99276e820000 from 1 10000000:01000000:0.0:1787853706.720410:0:15093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787853706.720435:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927587a8e00/0xcf1365f7cb0559ac lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.720443:0:15093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9927587a8e00/0xcf1365f7cb0559ac lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.720452:0:15093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927587a8e00/0xcf1365f7cb0559ac lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853706.720470:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152167424:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787853706.720507:0:15093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853706.720540:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276e832300 going to sleep for 11 seconds 00000100:00100000:2.0:1787853706.720601:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152167424 00000100:00100000:2.0:1787853706.720607:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152167424 00000100:00100000:2.0:1787853706.720640:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787853706.720647:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+12:15093:x1874700152167424:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787853706.720657:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853706.720668:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992747f70400/0xcf1365f7cb0559b3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0559ac expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853706.720723:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992747f70400/0xcf1365f7cb0559b3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0559ac expref: 13 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853706.720734:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992747f70400/0xcf1365f7cb0559b3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0559ac expref: 13 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853706.720742:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70400, rc 0) 00000100:00100000:2.0:1787853706.720943:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+13:15093:x1874700152167424:12345-0@lo:101:mount.lustre.0 Request processed in 295us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853706.720950:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787853706.721854:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152167424:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787853706.721870:0:15093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927587a8e00/0xcf1365f7cb0559ac lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0559b3 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853706.721881:0:15093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927587a8e00/0xcf1365f7cb0559ac lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0559b3 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853706.721898:0:15093:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787853706.721947:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927587a8e00/0xcf1365f7cb0559ac lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0559b3 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853706.721955:0:15093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9927587a8e00/0xcf1365f7cb0559ac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0559b3 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787853706.721963:0:15093:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787853706.721968:0:15093:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787853706.721973:0:15093:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787853706.721975:0:15093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787853706.722014:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992766197200/0xcf1365f7cb0559ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853706.722021:0:15093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992766197200/0xcf1365f7cb0559ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853706.722029:0:15093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992766197200/0xcf1365f7cb0559ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853706.722043:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748346580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152167552:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787853706.722079:0:15093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853706.722111:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927601d3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787853706.723830:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152167552 00000100:00100000:0.0:1787853706.723842:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152167552 00000100:00100000:0.0:1787853706.723893:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787853706.723912:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+13:15093:x1874700152167552:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853706.723928:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853706.723943:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927587a8400/0xcf1365f7cb0559c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0559ba expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.723967:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927587a8400/0xcf1365f7cb0559c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0559ba expref: 14 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.723978:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927587a8400/0xcf1365f7cb0559c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0559ba expref: 14 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.723987:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a8400, rc 0) 00000100:00100000:0.0:1787853706.724046:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+14:15093:x1874700152167552:12345-0@lo:101:mount.lustre.0 Request processed in 135us (1965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853706.724052:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787853706.724175:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748346580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152167552:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853706.724190:0:15093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992766197200/0xcf1365f7cb0559ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0559c1 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853706.724199:0:15093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992766197200/0xcf1365f7cb0559ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0559c1 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787853706.724988:0:15093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787853706.726902:0:15093:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787853706.727327:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787853706.727386:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787853706.727422:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787853706.727471:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787853706.727507:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787853706.727540:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787853706.727604:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787853706.727612:0:15093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787853706.728833:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152167680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853706.728902:0:15093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853706.728938:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274607e600 going to sleep for 11 seconds 00000100:00100000:0.0:1787853706.729011:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152167680 00000100:00100000:0.0:1787853706.729017:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152167680 00000100:00100000:0.0:1787853706.729061:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787853706.729068:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+14:15093:x1874700152167680:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853706.729373:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+14:15093:x1874700152167680:12345-0@lo:501:mount.lustre.0 Request processed in 304us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853706.729382:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787853706.729490:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152167680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853706.729523:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152167808:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853706.729562:0:15093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853706.729634:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274607e600 going to sleep for 11 seconds 00000100:00100000:1.0:1787853706.732194:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152167808 00000100:00100000:1.0:1787853706.732206:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152167808 00000100:00100000:1.0:1787853706.732290:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787853706.732299:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+14:15093:x1874700152167808:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853706.732870:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152167808:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787853706.733448:0:15093:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787853706.733511:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152167936:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787853706.733558:0:15093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853706.733587:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+14:15093:x1874700152167808:12345-0@lo:503:mount.lustre.0 Request processed in 1288us (4024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853706.733595:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787853706.737602:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff99274607e600 going to sleep for 11 seconds 00000100:00100000:3.0:1787853706.738353:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152167936 00000100:00100000:3.0:1787853706.738362:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152167936 00000100:00100000:3.0:1787853706.738412:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787853706.738422:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+14:15093:x1874700152167936:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787853706.738939:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+14:15093:x1874700152167936:12345-0@lo:502:mount.lustre.0 Request processed in 518us (5379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853706.738948:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787853706.741654:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152167936:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787853706.742090:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787853706.742152:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787853706.742190:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787853706.742242:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787853706.742281:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787853706.742316:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787853706.742365:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787853706.742405:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787853706.742447:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787853706.742515:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787853706.742552:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787853706.742603:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787853706.742642:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748344b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152168064:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853706.742840:0:15093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853706.742923:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927601d3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787853706.742999:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152168064 00000100:00100000:0.0:1787853706.743006:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152168064 00000100:00100000:2.0:1787853706.743102:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787853706.743167:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+14:15093:x1874700152168064:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853706.743362:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+14:15093:x1874700152168064:12345-0@lo:502:mount.lustre.0 Request processed in 251us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853706.743376:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787853706.744873:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748344b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152168064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787853706.744987:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787853706.745001:0:15093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1787853706.747017:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787853706.747027:0:15108:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787853706.747033:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853706.747035:0:15108:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787853706.747040:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787853706.747069:0:15108:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9926417c19d0) 00000020:00000080:3.0:1787853706.747089:0:15108:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787853706.747095:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787853706.747158:0:15108:0:(tgt_mount.c:153:server_get_mount()) get mount ffff992758c39000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787853706.747165:0:15108:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787853706.747171:0:15108:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf1365f7cb0559cf 00010000:00010000:3.0:1787853706.753812:0:15108:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1787853706.754195:0:15108:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1787853706.756574:0:15108:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787853706.759055:0:15108:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787853706.759066:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853706.759072:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853706.759074:0:15108:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787853706.759077:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787853706.759080:0:15108:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1787853706.759081:0:15108:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787853706.759083:0:15108:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787853706.759085:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787853706.759087:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853706.759094:0:15108:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787853706.759098:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787853706.759101:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853706.759102:0:15108:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787853706.759105:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787853706.759107:0:15108:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787853706.759109:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853706.759112:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853706.759113:0:15108:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787853706.759115:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787853706.759118:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853706.759119:0:15108:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787853706.759122:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787853706.759173:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787853706.759177:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787853706.759178:0:15108:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787853706.759182:0:15108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787853706.760909:0:15093:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787853706.760952:0:15093:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787853706.760967:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992766197200/0xcf1365f7cb0559ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0559c1 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853706.760980:0:15093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992766197200/0xcf1365f7cb0559ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0559c1 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853706.761005:0:15093:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff992758c39000 from 1 10000000:01000000:2.0:1787853706.761008:0:15093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787853706.761042:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb0559d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853706.761049:0:15093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb0559d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853706.761061:0:15093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb0559d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853706.761083:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642104b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152168192:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787853706.761144:0:15093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853706.761182:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff992742c2eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787853706.761835:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152168192 00000100:00100000:0.0:1787853706.761844:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152168192 00000100:00100000:0.0:1787853706.761893:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787853706.761902:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992749175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+14:15093:x1874700152168192:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853706.761926:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853706.761938:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927587a9600/0xcf1365f7cb0559dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0559d6 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.761963:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927587a9600/0xcf1365f7cb0559dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0559d6 expref: 15 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.761974:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927587a9600/0xcf1365f7cb0559dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0559d6 expref: 15 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.761982:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a9600, rc 0) 00000100:00100000:0.0:1787853706.762033:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992749175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+15:15093:x1874700152168192:12345-0@lo:101:mount.lustre.0 Request processed in 132us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853706.762040:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787853706.762153:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642104b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152168192:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787853706.762168:0:15093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb0559d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0559dd expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853706.762176:0:15093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb0559d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0559dd expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787853706.762657:0:15093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787853706.763372:0:15093:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787853706.763623:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787853706.765823:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787853706.765996:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787853706.766006:0:15093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787853706.766096:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642104b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152168320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853706.766170:0:15093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853706.766258:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff992742c2eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787853706.773937:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152168320 00000100:00100000:0.0:1787853706.773950:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152168320 00000100:00100000:0.0:1787853706.774001:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787853706.774011:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992749175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+15:15093:x1874700152168320:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853706.774272:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992749175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+15:15093:x1874700152168320:12345-0@lo:501:mount.lustre.0 Request processed in 262us (8101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853706.774280:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787853706.775863:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642104b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152168320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853706.775922:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642104b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152168448:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787853706.775990:0:15093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853706.776027:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff992742c2eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787853706.776183:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152168448 00000100:00100000:3.0:1787853706.776189:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152168448 00000100:00100000:3.0:1787853706.776233:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787853706.776242:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992749176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+15:15093:x1874700152168448:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853706.776400:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992749176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+15:15093:x1874700152168448:12345-0@lo:503:mount.lustre.0 Request processed in 159us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853706.776407:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787853706.777183:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642104b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152168448:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787853706.777650:0:15093:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787853706.778176:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642104b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152168576:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853706.778237:0:15093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853706.778311:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927412ed000 going to sleep for 11 seconds 00000100:00100000:0.0:1787853706.781550:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152168576 00000100:00100000:0.0:1787853706.781562:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152168576 00000100:00100000:0.0:1787853706.781621:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787853706.781631:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992742ca3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+15:15093:x1874700152168576:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787853706.783252:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992742ca3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+15:15093:x1874700152168576:12345-0@lo:502:mount.lustre.0 Request processed in 1617us (5010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853706.783273:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787853706.785308:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642104b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152168576:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787853706.785614:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787853706.786360:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787853706.786428:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787853706.786466:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787853706.786502:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787853706.786552:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787853706.786588:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787853706.786621:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787853706.786662:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642104b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152168704:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853706.787325:0:15093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853706.787404:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff992742c2eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787853706.790847:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152168704 00000100:00100000:3.0:1787853706.790860:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152168704 00000100:00100000:3.0:1787853706.790917:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787853706.790927:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992742ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+15:15093:x1874700152168704:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787853706.791322:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992742ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+15:15093:x1874700152168704:12345-0@lo:502:mount.lustre.0 Request processed in 396us (3996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853706.791330:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787853706.792878:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642104b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152168704:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787853706.793055:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787853706.793078:0:15093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787853706.794945:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853706.794956:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853706.794958:0:15112:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787853706.794967:0:15112:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff992758c39000 00000020:00000080:1.0:1787853706.794969:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787853706.794975:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853706.794977:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853706.794979:0:15112:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787853706.794981:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853706.794983:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853706.794985:0:15112:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787853706.794988:0:15112:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff992758c39000 00000020:00000080:1.0:1787853706.794990:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787853706.795047:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853706.795051:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853706.795052:0:15112:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787853706.795054:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853706.795057:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853706.795058:0:15112:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787853706.795061:0:15112:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff992758c39000 00000020:00000080:1.0:1787853706.795063:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787853706.795090:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853706.795093:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853706.795095:0:15112:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787853706.795098:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787853706.795800:0:15093:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787853706.795821:0:15093:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787853706.795841:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb0559d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0559dd expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853706.795853:0:15093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb0559d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0559dd expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853706.795894:0:15093:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787853706.795897:0:15093:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff992758c39000 10000000:01000000:2.0:1787853706.795900:0:15093:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff992758c39000 10000000:01000000:2.0:1787853706.795903:0:15093:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787853706.795909:0:15093:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff992758c39000 from 1 10000000:01000000:2.0:1787853706.795911:0:15093:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787853706.795943:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb0559e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853706.795952:0:15093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb0559e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853706.795962:0:15093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb0559e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853706.795983:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642104b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152168832:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787853706.796041:0:15093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853706.796079:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152168832 00000100:00100000:2.0:1787853706.796081:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff992742c2eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787853706.796085:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152168832 00000100:00100000:1.0:1787853706.796130:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787853706.796139:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992742ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+15:15093:x1874700152168832:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787853706.796151:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853706.796169:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992766196600/0xcf1365f7cb0559eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb0559e4 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853706.796190:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992766196600/0xcf1365f7cb0559eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb0559e4 expref: 16 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853706.796200:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992766196600/0xcf1365f7cb0559eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0559e4 expref: 16 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853706.796208:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196600, rc 0) 00000100:00100000:1.0:1787853706.796251:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992742ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:15093:x1874700152168832:12345-0@lo:101:mount.lustre.0 Request processed in 114us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853706.796258:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787853706.796316:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642104b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152168832:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787853706.796328:0:15093:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb0559e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0559eb expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853706.796349:0:15093:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb0559e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb0559eb expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787853706.796973:0:15093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787853706.797231:0:15093:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787853706.797469:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787853706.797513:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787853706.797549:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787853706.797598:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787853706.797635:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787853706.800904:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787853706.800985:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787853706.801021:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787853706.801071:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787853706.801106:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787853706.801140:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787853706.801184:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787853706.801218:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787853706.801251:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787853706.801299:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787853706.801332:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787853706.801380:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787853706.801431:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787853706.801467:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787853706.801500:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787853706.801551:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787853706.801587:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787853706.801622:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787853706.801699:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787853706.804417:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787853706.804448:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787853706.804509:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787853706.804553:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787853706.804626:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787853706.804632:0:15093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787853706.804748:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748344b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152168960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853706.804811:0:15093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853706.804852:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787853706.805124:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152168960 00000100:00100000:0.0:1787853706.805130:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152168960 00000100:00100000:0.0:1787853706.805168:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787853706.805175:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992742ca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:15093:x1874700152168960:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853706.805381:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992742ca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:15093:x1874700152168960:12345-0@lo:501:mount.lustre.0 Request processed in 206us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853706.805389:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787853706.807821:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748344b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152168960:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853706.807875:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152169088:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787853706.807937:0:15093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853706.807972:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276e832cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853706.808045:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152169088 00000100:00100000:3.0:1787853706.808050:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152169088 00000100:00100000:3.0:1787853706.808091:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787853706.808099:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992760812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:15093:x1874700152169088:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853706.808256:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992760812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:15093:x1874700152169088:12345-0@lo:503:mount.lustre.0 Request processed in 156us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853706.808263:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787853706.808345:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152169088:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787853706.810209:0:15093:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787853706.810282:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152169216:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787853706.810348:0:15093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853706.810389:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276e832cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853706.810545:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152169216 00000100:00100000:1.0:1787853706.810551:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152169216 00000100:00100000:1.0:1787853706.810586:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787853706.810594:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:15093:x1874700152169216:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853706.810816:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:15093:x1874700152169216:12345-0@lo:502:mount.lustre.0 Request processed in 223us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853706.810824:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787853706.812548:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152169216:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787853706.812961:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787853706.813022:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787853706.813058:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787853706.813115:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787853706.813152:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787853706.813202:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787853706.813239:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787853706.813275:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787853706.813324:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787853706.813358:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787853706.813394:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787853706.813445:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787853706.813483:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787853706.813521:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787853706.813571:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787853706.813609:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787853706.813644:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787853706.818771:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787853706.818858:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787853706.818896:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787853706.818973:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787853706.819015:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787853706.819049:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787853706.819100:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787853706.819137:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787853706.819171:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787853706.819223:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787853706.819260:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787853706.819308:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787853706.819359:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787853706.819410:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787853706.819445:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787853706.819480:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787853706.819603:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787853706.819641:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787853706.819716:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787853706.819753:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787853706.819785:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787853706.819829:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787853706.819863:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787853706.819906:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748346580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152169344:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853706.819980:0:15093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853706.820025:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0600 going to sleep for 11 seconds 00000100:00100000:3.0:1787853706.821360:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152169344 00000100:00100000:3.0:1787853706.821371:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152169344 00000100:00100000:3.0:1787853706.821433:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787853706.821442:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:15093:x1874700152169344:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787853706.821716:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:15093:x1874700152169344:12345-0@lo:502:mount.lustre.0 Request processed in 259us (1719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853706.821724:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787853706.822310:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748346580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152169344:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787853706.823947:0:15093:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787853706.823965:0:15093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787853706.835999:0:15117:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787853706.836015:0:15117:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9927436499d0) 00000020:00000080:2.0:1787853706.836034:0:15117:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1787853706.836107:0:15117:0:(tgt_mount.c:153:server_get_mount()) get mount ffff992758c39000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787853706.836111:0:15117:0:(tgt_mount.c:187:server_put_mount()) put mount ffff992758c39000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787853706.836114:0:15117:0:(obd_mount.c:710:lustre_put_lsi()) put ffff992758c39000 3 00010000:00080000:2.0:1787853706.836141:0:15117:0:(ldlm_lib.c:102:import_set_conn()) imp ffff992641e03800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.110@tcp at head 00010000:00010000:2.0:1787853706.840029:0:15117:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1787853706.840281:0:15117:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787853706.840317:0:15117:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787853706.840330:0:15117:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcf1365f7cb0559f9 00000100:00080000:2.0:1787853706.840340:0:15117:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787853706.840346:0:15117:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff992641e03800 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:2.0:1787853706.840380:0:15117:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff992642104b40 x1874700152169472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787853706.840408:0:15117:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787853706.840492:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642104b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3296:1874700152169472:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787853706.840575:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787853706.841248:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853706.841254:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787853706.841257:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853706.841260:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787853706.841330:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152169600:0@lo:400:kworker.0 00000100:00100000:0.0:1787853706.841372:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853706.841447:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152169472 00000100:00100000:3.0:1787853706.841454:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152169472 00000100:00100000:3.0:1787853706.841507:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152169600 00000100:00100000:3.0:1787853706.841511:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152169600 00000100:00100000:0.0:1787853706.842749:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787853706.842761:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152169600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853706.842825:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152169600:12345-0@lo:400:kworker.0 Request processed in 68us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853706.842832:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787853706.842852:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787853706.842856:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3296:x1874700152169472:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787853706.842877:0:14415:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 401 last 0 00000020:00000080:0.0:1787853706.842910:0:14415:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcf1365f7cb055a00 00000004:00100000:0.0:1787853706.842922:0:14415:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787853706.842949:0:14415:0:(import.c:65:import_set_state_nolock()) ffff9927441bc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853706.842985:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1874700152169472:12345-0@lo:38:llog_process_th.0 Request processed in 128us (2410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853706.842991:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787853706.843028:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff992642104b40 x1874700152169472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787853716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853706.843038:0:3296:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787853706.843045:0:3296:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787853706.843051:0:3296:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787853706.843054:0:3296:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787853706.843056:0:3296:0:(import.c:65:import_set_state_nolock()) ffff992641e03800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787853706.843062:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642104b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3296:1874700152169472:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787853706.843091:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99277522cb40 x1874700152169600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853706.843117:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152169600:0@lo:400:kworker.0 00000040:00080000:2.0:1787853706.845984:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787853706.846215:0:15093:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787853706.846242:0:15093:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787853706.846270:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb0559e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0559eb expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853706.846282:0:15093:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992747f71800/0xcf1365f7cb0559e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb0559eb expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787853706.846324:0:15093:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787853706.846326:0:15093:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787853706.846327:0:15093:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853706.846328:0:15093:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853706.846330:0:15093:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853706.846331:0:15093:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853706.846332:0:15093:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787853706.846334:0:15093:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853706.846336:0:15093:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787853706.846339:0:15093:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787853706.846341:0:15093:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787853706.846343:0:15093:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787853706.846344:0:15093:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853706.846345:0:15093:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853706.846346:0:15093:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853706.846347:0:15093:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853706.846348:0:15093:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787853706.846349:0:15093:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853706.846350:0:15093:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787853706.846371:0:15093:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787853706.846389:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748346580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152169728:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787853706.846452:0:15093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853706.846487:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152169728 00000100:00100000:1.0:1787853706.846493:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152169728 00000100:00100000:1.0:1787853706.846530:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787853706.846538:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:15093:x1874700152169728:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787853706.846572:0:14408:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787853706.846585:0:14408:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787853706.848329:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0600 going to sleep for 11 seconds 20000000:01000000:1.0:1787853706.987054:0:14408:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787853706.987074:0:14408:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787853706.987215:0:14429:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787853706.987235:0:14429:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787853706.987256:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a07 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853706.987274:0:14429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9927587a9c00/0xcf1365f7cb055974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb05596d expref: 16 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853706.987282:0:14429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a07 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853706.987319:0:14429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9927587a9c00/0xcf1365f7cb055974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb05596d expref: 16 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853706.987334:0:14429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9927587a9c00/0xcf1365f7cb055974 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb05596d expref: 16 pid: 14405 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853706.987348:0:14429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9926421052c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14429:1874700152169856:0@lo:104: 00000100:00100000:2.0:1787853706.987409:0:14429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853706.987469:0:14429:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d550540 going to sleep for 11 seconds 00000100:00100000:0.0:1787853706.987538:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152169856 00000100:00100000:0.0:1787853706.987545:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152169856 00000100:00100000:0.0:1787853706.987593:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787853706.987602:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642104b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+3:14429:x1874700152169856:12345-0@lo:104: 00010000:00010000:0.0:1787853706.987614:0:14396:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05596d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb055974 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.987686:0:14396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787853706.987692:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642104b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+3:14429:x1874700152169856:12345-0@lo:104: Request processed in 93us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853706.987698:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787853706.987732:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853706.987737:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05596d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb055974 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.987744:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8a00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:0.0:1787853706.987747:0:14401:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05596d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb055974 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.987755:0:14401:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05596d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb055974 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787853706.987761:0:14401:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05596d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb055974 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853706.987767:0:14401:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787853706.987794:0:14401:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05596d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb055974 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.987807:0:14401:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787853706.987825:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05596d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb055974 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.987832:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9927587a8a00/0xcf1365f7cb05596d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb055974 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.987847:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853706.987849:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853706.987850:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853706.987866:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3299:1874700152169984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787853706.987896:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853706.987930:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152169984 00000100:00100000:0.0:1787853706.987934:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152169984 00010000:00010000:0.0:1787853706.987950:0:14400:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9927587a9c00/0xcf1365f7cb055974 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb05596d expref: 17 pid: 14405 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853706.987970:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787853706.987976:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+17:3299:x1874700152169984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853706.987986:0:14400:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853706.987990:0:14400:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9927587a9c00/0xcf1365f7cb055974 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb05596d expref: 17 pid: 14405 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.988000:0:14400:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9927587a9c00/0xcf1365f7cb055974 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb05596d expref: 17 pid: 14405 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.988014:0:14400:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a07 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.988032:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a07 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787853706.988043:0:14400:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002242512s 00010000:00010000:0.0:1787853706.988047:0:14400:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.988054:0:14400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.988059:0:14400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a07 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.988065:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.988070:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70000 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853706.988073:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.988080:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a07 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.988087:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a07 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853706.988095:0:14400:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853706.988124:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+17:3299:x1874700152169984:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853706.988130:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787853706.988171:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3299:1874700152169984:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787853706.988263:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927587a9c00/0xcf1365f7cb055974 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb05596d expref: 16 pid: 14405 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853706.988272:0:14429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9926421052c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14429:1874700152169856:0@lo:104: 00010000:00010000:2.0:1787853706.988283:0:14429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853706.988291:0:14429:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853706.988298:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853706.988314:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a07 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853707.011851:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+15:15093:x1874700152169728:12345-0@lo:253:mount.lustre.0 Request processed in 165305us (165390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853707.011865:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787853707.011968:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748346580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15093:1874700152169728:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787853707.011982:0:15093:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787853707.011986:0:15093:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787853707.011987:0:15093:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787853707.011989:0:15093:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787853707.011990:0:15093:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787853707.011992:0:15093:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787853707.011993:0:15093:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787853707.011994:0:15093:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787853707.011996:0:15093:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787853707.011997:0:15093:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787853707.012012:0:15093:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787853707.018400:0:15093:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787853707.018533:0:15093:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787853707.018652:0:15093:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787853707.018879:0:15093:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787853707.018992:0:15093:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787853707.019157:0:15093:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787853707.022039:0:15093:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1787853707.077860:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787853707.139176:0:15093:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787853707.139184:0:15093:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787853707.139216:0:15093:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787853707.139271:0:15093:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.110@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787853707.139283:0:15093:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787853707.139313:0:15093:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000040:00080000:3.0:1787853707.398386:0:14445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787853708.101813:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787853708.999588:0:14410:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787853708.999594:0:14410:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff992641d72000 from 7 10000000:01000000:3.0:1787853708.999598:0:14410:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787853708.999636:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb055a0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853708.999654:0:14410:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb055a0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853708.999666:0:14410:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb055a0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853708.999737:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152170112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787853708.999857:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853708.999894:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276d1de180 going to sleep for 11 seconds 00000100:00100000:2.0:1787853708.999957:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152170112 00000100:00100000:2.0:1787853708.999964:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152170112 00000100:00100000:2.0:1787853709.000018:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787853709.000028:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c27ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+15:14410:x1874700152170112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853709.000040:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853709.000054:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb055a0e expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853709.000077:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb055a0e expref: 16 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853709.000088:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb055a0e expref: 16 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853709.000098:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f70000, rc 0) 00000100:00100000:2.0:1787853709.000140:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c27ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:14410:x1874700152170112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853709.000148:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787853709.000350:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152170112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853709.000365:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb055a0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055a15 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853709.000374:0:14410:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb055a0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb055a15 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853709.000424:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152170240:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787853709.000455:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853709.000485:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0300 going to sleep for 11 seconds 00000100:00100000:3.0:1787853709.001283:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152170240 00000100:00100000:3.0:1787853709.001292:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152170240 00000100:00100000:3.0:1787853709.001323:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787853709.001330:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:14410:x1874700152170240:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787853709.001346:0:14408:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787853709.001361:0:14408:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787853709.001364:0:14408:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787853709.001456:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:14410:x1874700152170240:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853709.001464:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787853709.001502:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152170240:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787853709.001555:0:14410:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787853709.001565:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb055a0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055a15 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853709.001575:0:14410:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb055a0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055a15 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853709.125870:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853710.149933:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853711.174139:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787853712.197932:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853712.197938:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787853712.197941:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787853712.197943:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787853712.197990:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3300:1874700152170368:0@lo:400:kworker.0 00000100:00100000:3.0:1787853712.198149:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853712.198215:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152170496:0@lo:400:kworker.0 00000100:00100000:3.0:1787853712.198245:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853712.198268:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853712.198274:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152170624:0@lo:400:kworker.0 00000100:00100000:3.0:1787853712.198300:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853712.198331:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152170368 00000100:00100000:3.0:1787853712.198337:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152170368 00000100:00100000:3.0:1787853712.198376:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787853712.198383:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c27b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:3300:x1874700152170368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853712.199757:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c27b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:3300:x1874700152170368:12345-0@lo:400:kworker.0 Request processed in 1367us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853712.199770:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787853712.199816:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152170496 00000100:00100000:3.0:1787853712.199822:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152170496 00000100:00100000:3.0:1787853712.199852:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152170624 00000100:00100000:3.0:1787853712.199856:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152170624 00000100:00100000:3.0:1787853712.199880:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787853712.199887:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152170496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853712.199946:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1874700152170496:12345-0@lo:400:kworker.0 Request processed in 59us (1699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853712.199952:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787853712.199964:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787853712.199971:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152170624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853712.199997:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152170624:12345-0@lo:400:kworker.0 Request processed in 28us (1697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853712.200003:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787853712.200616:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787853712.200652:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99277522e1c0 x1874700152170624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853712.200667:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152170624:0@lo:400:kworker.0 00010000:00080000:3.0:1787853712.200708:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99277522c000 x1874700152170496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853712.200717:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3297:1874700152170496:0@lo:400:kworker.0 00000100:00100000:3.0:1787853712.200750:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3300:1874700152170368:0@lo:400:kworker.0 00010000:00010000:0.0:1787853712.202353:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787853712.581274:0:15462:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787853713.221865:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853714.248078:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853715.273263:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853716.295551:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853717.317824:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787853717.320247:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787853717.320254:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787853717.320257:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787853717.320260:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787853717.320315:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9926421061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152171008:0@lo:400:kworker.0 00000100:00100000:2.0:1787853717.320387:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853717.320404:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642107840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874700152170880:0@lo:400:kworker.0 00000100:00100000:0.0:1787853717.320443:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853717.320516:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3299:1874700152170752:0@lo:400:kworker.0 00000100:00100000:3.0:1787853717.320549:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853717.320765:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152171008 00000100:00100000:2.0:1787853717.320774:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152171008 00000100:00100000:3.0:1787853717.320777:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152170880 00000100:00100000:3.0:1787853717.320782:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152170880 00000100:00100000:2.0:1787853717.320838:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787853717.320848:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874700152170880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853717.320971:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874700152170880:12345-0@lo:400:kworker.0 Request processed in 124us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853717.320980:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787853717.321004:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787853717.321012:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642104f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152171008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853717.321047:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642104f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152171008:12345-0@lo:400:kworker.0 Request processed in 35us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853717.321055:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787853717.321148:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787853717.321177:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9926421061c0 x1874700152171008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853717.321191:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9926421061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152171008:0@lo:400:kworker.0 00010000:00080000:2.0:1787853717.321224:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff992642107840 x1874700152170880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853717.321247:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642107840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874700152170880:0@lo:400:kworker.0 00000100:00100000:0.0:1787853717.321665:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152170752 00000100:00100000:0.0:1787853717.321700:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152170752 00000100:00100000:0.0:1787853717.321732:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787853717.321747:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c27b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:3299:x1874700152170752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853717.321792:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c27b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:3299:x1874700152170752:12345-0@lo:400:kworker.0 Request processed in 46us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853717.321799:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787853717.321951:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3299:1874700152170752:0@lo:400:kworker.0 00000040:00080000:3.0:1787853717.639597:0:14445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787853718.346012:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853719.369897:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787853719.400813:0:15811:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787853719.400817:0:15811:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787853719.400918:0:15811:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9927441ba000 00000020:01000004:0.0:1787853719.400933:0:15811:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787853719.400946:0:15811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787853719.400960:0:15811:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9927661799d0) 00000020:00000080:0.0:1787853719.400978:0:15811:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787853719.449373:0:15811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787853719.449732:0:15811:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787853719.463712:0:15811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787853719.463967:0:15811:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787853719.464288:0:15811:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787853719.464629:0:15811:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 314: rc = 0 00100000:10000000:3.0:1787853719.464770:0:15811:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 314: rc = 0 00100000:10000000:3.0:1787853719.464863:0:15811:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 314: rc = 0 00100000:10000000:3.0:1787853719.467627:0:15811:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 547: rc = 0 00100000:10000000:3.0:1787853719.467943:0:15811:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 547: rc = 0 00100000:10000000:3.0:1787853719.470107:0:15811:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 547: rc = 0 00100000:10000000:3.0:1787853719.470478:0:15811:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 547: rc = 0 00100000:10000000:3.0:1787853719.470909:0:15811:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 547: rc = 0 00100000:10000000:3.0:1787853719.471200:0:15811:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 547: rc = 0 00000020:00000080:3.0:1787853719.476298:0:15811:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787853719.476313:0:15811:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787853719.476322:0:15811:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf1365f7cb055a23 00000020:01000004:3.0:1787853719.476331:0:15811:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787853719.476350:0:15811:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.110@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787853719.476354:0:15811:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.110@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787853719.476359:0:15811:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787853719.476382:0:15811:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787853719.476385:0:15811:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.110@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787853719.495010:0:15811:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.110@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787853719.495055:0:15811:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.110@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787853719.495059:0:15811:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787853719.495061:0:15811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787853719.495063:0:15811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787853719.495064:0:15811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787853719.495065:0:15811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787853719.495067:0:15811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787853719.495069:0:15811:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787853719.495071:0:15811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787853719.495072:0:15811:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787853719.495075:0:15811:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787853719.495078:0:15811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787853719.495079:0:15811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787853719.495081:0:15811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787853719.495082:0:15811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787853719.495083:0:15811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787853719.495084:0:15811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787853719.495085:0:15811:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787853719.495087:0:15811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787853719.495088:0:15811:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787853719.495113:0:15811:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787853719.495132:0:15811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642106940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152171136:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787853719.498279:0:15811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853719.498437:0:15811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0600 going to sleep for 11 seconds 00000100:00100000:3.0:1787853719.500890:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152171136 00000100:00100000:3.0:1787853719.500903:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152171136 00000100:00100000:0.0:1787853719.506015:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787853719.506040:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c27a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:15811:x1874700152171136:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787853719.506076:0:14407:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787853719.506080:0:14407:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787853719.506084:0:14407:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787853719.547337:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c27a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:15811:x1874700152171136:12345-0@lo:253:mount.lustre.0 Request processed in 41302us (49056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853719.547352:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787853719.547454:0:15811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642106940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152171136:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787853719.547468:0:15811:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787853719.547471:0:15811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787853719.547485:0:15811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787853719.547486:0:15811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787853719.547487:0:15811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787853719.547488:0:15811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787853719.547490:0:15811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787853719.547491:0:15811:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787853719.547493:0:15811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787853719.547494:0:15811:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787853719.547514:0:15811:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9927441ba000 from lustre-OST0001 10000000:01000000:2.0:1787853719.547535:0:15811:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787853719.547537:0:15811:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787853719.547543:0:15811:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99276e820000 local copy 00010000:00010000:2.0:1787853719.547553:0:15811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb055894 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05589b expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853719.548342:0:15811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642106940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152171264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853719.548392:0:15811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853719.548486:0:15811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0480 going to sleep for 11 seconds 00000100:00100000:3.0:1787853719.548872:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152171264 00000100:00100000:3.0:1787853719.548880:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152171264 00000100:00100000:3.0:1787853719.549007:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787853719.549017:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c27a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:15811:x1874700152171264:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853719.549254:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c27a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:15811:x1874700152171264:12345-0@lo:501:mount.lustre.0 Request processed in 237us (859us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787853719.549272:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787853719.549347:0:15811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642106940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152171264:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787853719.549366:0:15811:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.110@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787853719.549514:0:15811:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.110@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787853719.549522:0:15811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb055894 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05589b expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853719.549532:0:15811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992747f71000/0xcf1365f7cb055894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb05589b expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853719.549554:0:15811:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9927441ba000 10000000:01000000:2.0:1787853719.549559:0:15811:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787853719.549564:0:15811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787853719.549567:0:15811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787853719.549576:0:15811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787853719.549580:0:15811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787853719.549605:0:15811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71e00/0xcf1365f7cb055a2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853719.549613:0:15811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992747f71e00/0xcf1365f7cb055a2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853719.549621:0:15811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992747f71e00/0xcf1365f7cb055a2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853719.549651:0:15811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642106940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152171392:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787853719.549704:0:15811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853719.551107:0:15811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1787853719.551494:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152171392 00000100:00100000:0.0:1787853719.551502:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152171392 00000100:00100000:0.0:1787853719.551558:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787853719.551568:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c27b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:15811:x1874700152171392:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853719.551580:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853719.551596:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927587a8a00/0xcf1365f7cb055a31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb055a2a expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853719.551619:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927587a8a00/0xcf1365f7cb055a31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb055a2a expref: 17 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853719.551734:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927587a8a00/0xcf1365f7cb055a31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb055a2a expref: 17 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853719.551742:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a8a00, rc 0) 00000100:00100000:0.0:1787853719.551851:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c27b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+17:15811:x1874700152171392:12345-0@lo:101:mount.lustre.0 Request processed in 285us (2146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853719.551858:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787853719.555623:0:15811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642106940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152171392:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787853719.555666:0:15811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992747f71e00/0xcf1365f7cb055a2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055a31 expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853719.555788:0:15811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992747f71e00/0xcf1365f7cb055a2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb055a31 expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787853719.556515:0:15811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787853719.558909:0:15811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787853719.560330:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787853719.560396:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787853719.560424:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787853719.560466:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787853719.560496:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787853719.560522:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787853719.560585:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787853719.560603:0:15811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787853719.561351:0:15811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642106940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152171520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853719.561410:0:15811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853719.561511:0:15811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0300 going to sleep for 11 seconds 00000100:00100000:0.0:1787853719.567360:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152171520 00000100:00100000:0.0:1787853719.567372:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152171520 00000100:00100000:0.0:1787853719.567838:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787853719.567849:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c27bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+17:15811:x1874700152171520:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853719.568910:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c27bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+17:15811:x1874700152171520:12345-0@lo:501:mount.lustre.0 Request processed in 1060us (7495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853719.568920:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787853719.569037:0:15811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642106940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152171520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787853719.569085:0:15811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152171648:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853719.569206:0:15811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853719.569588:0:15811:0:(client.c:2715:ptlrpc_set_wait()) set ffff992760945e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787853719.571994:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152171648 00000100:00100000:2.0:1787853719.572005:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152171648 00000100:00100000:3.0:1787853719.572120:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787853719.572140:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+17:15811:x1874700152171648:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787853719.572524:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+17:15811:x1874700152171648:12345-0@lo:503:mount.lustre.0 Request processed in 395us (3395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853719.572533:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787853719.572759:0:15811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152171648:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787853719.573390:0:15811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787853719.573456:0:15811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642104780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152171776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853719.573500:0:15811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853719.573540:0:15811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0780 going to sleep for 11 seconds 00000100:00100000:3.0:1787853719.573620:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152171776 00000100:00100000:3.0:1787853719.573626:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152171776 00000100:00100000:3.0:1787853719.573666:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787853719.573705:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+17:15811:x1874700152171776:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787853719.573885:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+17:15811:x1874700152171776:12345-0@lo:502:mount.lustre.0 Request processed in 212us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853719.573893:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787853719.574108:0:15811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642104780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152171776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787853719.574322:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787853719.574371:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787853719.574408:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787853719.574458:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787853719.574497:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787853719.574533:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787853719.574584:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787853719.574631:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787853719.574743:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787853719.574773:0:15811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642104780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152171904:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853719.574821:0:15811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853719.574838:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152171904 00000100:00100000:0.0:1787853719.574845:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152171904 00000100:00100000:2.0:1787853719.574848:0:15811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0780 going to sleep for 11 seconds 00000100:00100000:0.0:1787853719.574913:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787853719.574922:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+17:15811:x1874700152171904:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787853719.575085:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+17:15811:x1874700152171904:12345-0@lo:502:mount.lustre.0 Request processed in 164us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853719.575093:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787853719.575393:0:15811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642104780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152171904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787853719.575460:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787853719.575470:0:15811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1787853719.577925:0:15812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787853719.577936:0:15812:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787853719.577943:0:15812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853719.577945:0:15812:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787853719.577952:0:15812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787853719.577977:0:15812:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99276617cd70) 00000020:00000080:0.0:1787853719.577996:0:15812:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787853719.578004:0:15812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787853719.578065:0:15812:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9927441ba000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787853719.578073:0:15812:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787853719.578080:0:15812:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf1365f7cb055a3f 00010000:00010000:1.0:1787853719.586555:0:15812:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1787853719.587043:0:15812:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1787853719.593403:0:15812:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787853719.594814:0:15812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787853719.594826:0:15812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853719.594831:0:15812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853719.594833:0:15812:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787853719.594837:0:15812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853719.594841:0:15812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853719.594849:0:15812:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787853719.594853:0:15812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787853719.594856:0:15812:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787853719.594858:0:15812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853719.594860:0:15812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853719.594861:0:15812:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787853719.594864:0:15812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787853719.594866:0:15812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853719.594868:0:15812:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787853719.594870:0:15812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787853719.594921:0:15812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787853719.594925:0:15812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787853719.594926:0:15812:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787853719.594930:0:15812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1787853719.595076:0:15811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1787853719.595101:0:15811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787853719.595123:0:15811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f71e00/0xcf1365f7cb055a2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055a31 expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853719.595142:0:15811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992747f71e00/0xcf1365f7cb055a2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055a31 expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787853719.595150:0:15811:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9927441ba000 from 1 10000000:01000000:0.0:1787853719.595152:0:15811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787853719.595182:0:15811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927587a8200/0xcf1365f7cb055a46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853719.595190:0:15811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff9927587a8200/0xcf1365f7cb055a46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853719.595199:0:15811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff9927587a8200/0xcf1365f7cb055a46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853719.595220:0:15811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152172032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787853719.595280:0:15811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853719.595320:0:15811:0:(client.c:2715:ptlrpc_set_wait()) set ffff992748db3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787853719.595453:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152172032 00000100:00100000:3.0:1787853719.595460:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152172032 00000100:00100000:3.0:1787853719.595504:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787853719.595512:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+17:15811:x1874700152172032:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787853719.595524:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853719.595536:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927821c6200/0xcf1365f7cb055a4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb055a46 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853719.595569:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927821c6200/0xcf1365f7cb055a4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb055a46 expref: 18 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853719.595580:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927821c6200/0xcf1365f7cb055a4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb055a46 expref: 18 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853719.595589:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927821c6200, rc 0) 00000100:00100000:3.0:1787853719.595627:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+18:15811:x1874700152172032:12345-0@lo:101:mount.lustre.0 Request processed in 116us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853719.595646:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787853719.595936:0:15811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152172032:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787853719.595951:0:15811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff9927587a8200/0xcf1365f7cb055a46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055a4d expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853719.595967:0:15811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff9927587a8200/0xcf1365f7cb055a46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb055a4d expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787853719.597298:0:15811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787853719.598011:0:15811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787853719.600667:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787853719.600733:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787853719.600791:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787853719.600799:0:15811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787853719.600902:0:15811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152172160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853719.600968:0:15811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853719.601014:0:15811:0:(client.c:2715:ptlrpc_set_wait()) set ffff992748db3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787853719.601157:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152172160 00000100:00100000:1.0:1787853719.601164:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152172160 00000100:00100000:1.0:1787853719.601217:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787853719.601226:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9926435a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+18:15811:x1874700152172160:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787853719.601432:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9926435a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+18:15811:x1874700152172160:12345-0@lo:501:mount.lustre.0 Request processed in 206us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853719.601440:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787853719.601623:0:15811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152172160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787853719.601668:0:15811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152172288:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787853719.601740:0:15811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853719.601762:0:15811:0:(client.c:2715:ptlrpc_set_wait()) set ffff992748db3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787853719.601839:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152172288 00000100:00100000:1.0:1787853719.601844:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152172288 00000100:00100000:1.0:1787853719.601865:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787853719.601871:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9926435a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+18:15811:x1874700152172288:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787853719.602314:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9926435a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+18:15811:x1874700152172288:12345-0@lo:503:mount.lustre.0 Request processed in 441us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853719.602322:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787853719.605185:0:15811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152172288:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787853719.605713:0:15811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787853719.605784:0:15811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642104780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152172416:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853719.605850:0:15811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853719.605890:0:15811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0780 going to sleep for 11 seconds 00000100:00100000:1.0:1787853719.606358:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152172416 00000100:00100000:1.0:1787853719.606366:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152172416 00000100:00100000:1.0:1787853719.606416:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787853719.606425:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9926435a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+18:15811:x1874700152172416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853719.606663:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9926435a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+18:15811:x1874700152172416:12345-0@lo:502:mount.lustre.0 Request processed in 239us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853719.606693:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787853719.608415:0:15811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642104780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152172416:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787853719.608725:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787853719.608785:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787853719.608834:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787853719.608871:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787853719.608908:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787853719.608960:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787853719.608996:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787853719.609030:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787853719.609065:0:15811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642104780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152172544:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853719.609251:0:15811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853719.609330:0:15811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0780 going to sleep for 11 seconds 00000100:00100000:1.0:1787853719.615850:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152172544 00000100:00100000:1.0:1787853719.615866:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152172544 00000100:00100000:1.0:1787853719.615923:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787853719.615933:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dca8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+18:15811:x1874700152172544:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853719.616206:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dca8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+18:15811:x1874700152172544:12345-0@lo:502:mount.lustre.0 Request processed in 274us (6955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853719.616213:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787853719.616492:0:15811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642104780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152172544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787853719.616649:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787853719.616664:0:15811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787853719.617645:0:15816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853719.617655:0:15816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853719.617657:0:15816:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787853719.617664:0:15816:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9927441ba000 00000020:00000080:0.0:1787853719.617666:0:15816:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787853719.617709:0:15816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853719.617725:0:15816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853719.617727:0:15816:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787853719.617743:0:15816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853719.617746:0:15816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853719.617747:0:15816:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787853719.617751:0:15816:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9927441ba000 00000020:00000080:0.0:1787853719.617753:0:15816:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787853719.620325:0:15816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853719.620336:0:15816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853719.620338:0:15816:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787853719.620341:0:15816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787853719.620345:0:15816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853719.620346:0:15816:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787853719.620350:0:15816:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9927441ba000 00000020:00000080:0.0:1787853719.620352:0:15816:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787853719.620447:0:15816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787853719.620450:0:15816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787853719.620452:0:15816:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787853719.620455:0:15816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787853719.621277:0:15811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787853719.621306:0:15811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787853719.621328:0:15811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff9927587a8200/0xcf1365f7cb055a46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055a4d expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853719.621341:0:15811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff9927587a8200/0xcf1365f7cb055a46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055a4d expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853719.621385:0:15811:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787853719.621388:0:15811:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9927441ba000 10000000:01000000:2.0:1787853719.621391:0:15811:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9927441ba000 10000000:01000000:2.0:1787853719.621400:0:15811:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787853719.621406:0:15811:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9927441ba000 from 1 10000000:01000000:2.0:1787853719.621408:0:15811:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787853719.621441:0:15811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb055a54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853719.621449:0:15811:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb055a54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853719.621459:0:15811:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb055a54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853719.621481:0:15811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642105e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152172672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787853719.621541:0:15811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853719.621582:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152172672 00000100:00100000:2.0:1787853719.621588:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152172672 00000100:00100000:2.0:1787853719.621629:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787853719.621648:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dca9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+18:15811:x1874700152172672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787853719.621660:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853719.621692:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992747f71600/0xcf1365f7cb055a5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb055a54 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853719.621714:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992747f71600/0xcf1365f7cb055a5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb055a54 expref: 19 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853719.621724:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992747f71600/0xcf1365f7cb055a5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb055a54 expref: 19 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853719.622047:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992747f71600, rc 0) 00000100:00100000:2.0:1787853719.622081:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dca9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:15811:x1874700152172672:12345-0@lo:101:mount.lustre.0 Request processed in 435us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853719.622094:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787853719.622204:0:15811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0540 going to sleep for 11 seconds 00000100:00100000:2.0:1787853719.622224:0:15811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642105e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152172672:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787853719.622239:0:15811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb055a54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055a5b expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853719.622248:0:15811:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb055a54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb055a5b expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787853719.623361:0:15811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1787853719.624277:0:15811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787853719.624526:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787853719.624571:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787853719.624605:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787853719.624669:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787853719.624740:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787853719.624788:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787853719.624822:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787853719.624858:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787853719.624909:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787853719.624947:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787853719.624977:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787853719.625038:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787853719.625071:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787853719.625099:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787853719.625141:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787853719.625175:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787853719.625202:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787853719.625242:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787853719.625277:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787853719.625329:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787853719.625390:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787853719.625423:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787853719.625452:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787853719.627897:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787853719.627945:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787853719.627975:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787853719.628016:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787853719.628049:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787853719.628079:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787853719.628118:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1787853719.628169:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1787853719.628202:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1787853719.628234:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1787853719.628281:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1787853719.628318:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1787853719.628391:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1787853719.628430:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1787853719.628518:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1787853719.628526:0:15811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1787853719.628619:0:15811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642105e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152172800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853719.628716:0:15811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853719.628763:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152172800 00000100:00100000:2.0:1787853719.628770:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152172800 00000100:00100000:2.0:1787853719.628811:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787853719.628819:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dcaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:15811:x1874700152172800:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853719.629030:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dcaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:15811:x1874700152172800:12345-0@lo:501:mount.lustre.0 Request processed in 211us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853719.629038:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787853719.629079:0:15811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0540 going to sleep for 11 seconds 00000100:00100000:2.0:1787853719.629105:0:15811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642105e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152172800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787853719.629135:0:15811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642105e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152172928:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787853719.629170:0:15811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853719.629190:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152172928 00000100:00100000:2.0:1787853719.629194:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152172928 00000100:00100000:2.0:1787853719.629213:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787853719.629218:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dca9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:15811:x1874700152172928:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787853719.629461:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dca9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:15811:x1874700152172928:12345-0@lo:503:mount.lustre.0 Request processed in 241us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853719.629468:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787853719.629496:0:15811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0540 going to sleep for 11 seconds 00000100:00100000:2.0:1787853719.629508:0:15811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642105e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152172928:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787853719.629996:0:15811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787853719.630045:0:15811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642105e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152173056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853719.630084:0:15811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853719.630115:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152173056 00000100:00100000:2.0:1787853719.630120:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152173056 00000100:00100000:2.0:1787853719.630144:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787853719.630150:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dcab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:15811:x1874700152173056:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853719.630351:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dcab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:15811:x1874700152173056:12345-0@lo:502:mount.lustre.0 Request processed in 200us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853719.630359:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787853719.630392:0:15811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0540 going to sleep for 11 seconds 00000100:00100000:2.0:1787853719.630406:0:15811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642105e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152173056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787853719.640251:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787853719.640341:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787853719.640373:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787853719.640414:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787853719.640447:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787853719.640490:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787853719.640523:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787853719.640556:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787853719.640605:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787853719.640656:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787853719.640726:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787853719.640776:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787853719.640812:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787853719.640845:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787853719.640893:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787853719.640932:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787853719.640962:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787853719.641008:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787853719.641048:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787853719.641079:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787853719.641137:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787853719.641175:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787853719.641206:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787853719.641253:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787853719.641289:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787853719.641323:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787853719.641410:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787853719.641445:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787853719.641471:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787853719.641508:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787853719.641537:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787853719.641571:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1787853719.641605:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1787853719.641700:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1787853719.641749:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1787853719.641802:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1787853719.641838:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1787853719.641873:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1787853719.641919:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1787853719.641951:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1787853719.641998:0:15811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642105e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152173184:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787853719.642078:0:15811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853719.642126:0:15811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0540 going to sleep for 11 seconds 00000100:00100000:1.0:1787853719.643269:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152173184 00000100:00100000:1.0:1787853719.643278:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152173184 00000100:00100000:1.0:1787853719.646422:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787853719.646437:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dca9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:15811:x1874700152173184:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787853719.646772:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dca9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:15811:x1874700152173184:12345-0@lo:502:mount.lustre.0 Request processed in 337us (4693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853719.646779:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787853719.646921:0:15811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642105e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152173184:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787853719.647029:0:15811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787853719.647044:0:15811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787853719.650612:0:15821:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787853719.650629:0:15821:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff992743648000) 00000020:00000080:2.0:1787853719.650662:0:15821:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1787853719.650747:0:15821:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9927441ba000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787853719.650751:0:15821:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9927441ba000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787853719.650754:0:15821:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9927441ba000 3 00010000:00080000:2.0:1787853719.650785:0:15821:0:(ldlm_lib.c:102:import_set_conn()) imp ffff992746bc6000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.110@tcp at head 00010000:00010000:2.0:1787853719.654314:0:15821:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1787853719.654519:0:15821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787853719.654556:0:15821:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787853719.654569:0:15821:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcf1365f7cb055a69 00000100:00080000:2.0:1787853719.654579:0:15821:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787853719.654585:0:15821:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff992746bc6000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:2.0:1787853719.654618:0:15821:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff992642105e00 x1874700152173312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787853719.654754:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642105e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3296:1874700152173312:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787853719.654824:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853719.654881:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152173312 00000100:00100000:2.0:1787853719.654888:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152173312 00000100:00100000:2.0:1787853719.654916:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787853719.654923:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642105a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3296:x1874700152173312:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787853719.654944:0:14413:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 413 last 0 00000020:00000080:2.0:1787853719.654975:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcf1365f7cb055a70 00000004:00100000:2.0:1787853719.654988:0:14413:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787853719.655021:0:14413:0:(import.c:65:import_set_state_nolock()) ffff992641e07800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787853719.657174:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642105a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1874700152173312:12345-0@lo:38:llog_process_th.0 Request processed in 141us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853719.657189:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787853719.657257:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff992642105e00 x1874700152173312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787853729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853719.657268:0:3296:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787853719.657277:0:3296:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787853719.657285:0:3296:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787853719.657289:0:3296:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787853719.657292:0:3296:0:(import.c:65:import_set_state_nolock()) ffff992746bc6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787853719.657299:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642105e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3296:1874700152173312:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787853719.657323:0:15821:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787853719.657349:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787853719.657354:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787853719.657357:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787853719.657372:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787853719.657438:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642105e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152173440:0@lo:400:kworker.0 00000100:00100000:2.0:1787853719.657492:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853719.657528:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787853719.657536:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642106580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1874700152173568:0@lo:400:kworker.0 00000100:00100000:2.0:1787853719.657560:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853719.657584:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152173440 00000100:00100000:2.0:1787853719.657589:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152173440 00000100:00100000:2.0:1787853719.657623:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152173568 00000100:00100000:2.0:1787853719.657627:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152173568 00000100:00100000:2.0:1787853719.657689:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787853719.657698:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642104780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152173440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853719.657745:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642104780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152173440:12345-0@lo:400:kworker.0 Request processed in 49us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853719.657752:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787853719.657764:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787853719.657771:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642106940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874700152173568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853719.657802:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642106940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874700152173568:12345-0@lo:400:kworker.0 Request processed in 31us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853719.657807:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1787853719.657824:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787853719.657842:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff992642106580 x1874700152173568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853719.657853:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642106580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1874700152173568:0@lo:400:kworker.0 00010000:00080000:2.0:1787853719.657875:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff992642105e00 x1874700152173440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853719.657891:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642105e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152173440:0@lo:400:kworker.0 00000040:00080000:3.0:1787853719.663954:0:15821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1787853719.664108:0:15811:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787853719.664148:0:15811:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787853719.664169:0:15811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb055a54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055a5b expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853719.664180:0:15811:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992747f70800/0xcf1365f7cb055a54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055a5b expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787853719.664225:0:15811:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787853719.664227:0:15811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787853719.664228:0:15811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787853719.664230:0:15811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787853719.664231:0:15811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787853719.664232:0:15811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787853719.664233:0:15811:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787853719.664235:0:15811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787853719.664236:0:15811:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787853719.664240:0:15811:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787853719.664242:0:15811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787853719.664243:0:15811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787853719.664244:0:15811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787853719.664245:0:15811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787853719.664246:0:15811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787853719.664247:0:15811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787853719.664248:0:15811:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787853719.664249:0:15811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787853719.664250:0:15811:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787853719.664274:0:15811:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787853719.664292:0:15811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642105e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152173696:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787853719.664368:0:15811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853719.664401:0:15811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927434d0600 going to sleep for 11 seconds 00000100:00100000:2.0:1787853719.664421:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152173696 00000100:00100000:2.0:1787853719.664434:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152173696 00000100:00100000:2.0:1787853719.664471:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787853719.664479:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:15811:x1874700152173696:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787853719.664501:0:14408:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787853719.664513:0:14408:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787853719.723989:0:14408:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787853719.724010:0:14408:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787853719.724319:0:14429:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787853719.724324:0:14429:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787853719.724344:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055a77 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853719.724363:0:14429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb055a0e expref: 19 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853719.724372:0:14429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055a77 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853719.724412:0:14429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb055a0e expref: 19 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853719.724426:0:14429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb055a0e expref: 19 pid: 14407 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853719.724440:0:14429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522e1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14429:1874700152173824:0@lo:104: 00000100:00100000:3.0:1787853719.724513:0:14429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853719.724574:0:14429:0:(client.c:2715:ptlrpc_set_wait()) set ffff992746bfad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787853719.724661:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152173824 00000100:00100000:2.0:1787853719.724668:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152173824 00000100:00100000:2.0:1787853719.724744:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787853719.724752:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+3:14429:x1874700152173824:12345-0@lo:104: 00010000:00010000:2.0:1787853719.724764:0:14397:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb055a0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb055a15 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853719.724812:0:14397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787853719.724817:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+3:14429:x1874700152173824:12345-0@lo:104: Request processed in 67us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853719.724824:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787853719.724844:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853719.724849:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb055a0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb055a15 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853719.724857:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c6a00 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1787853719.724860:0:14401:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb055a0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb055a15 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853719.724869:0:14401:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb055a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb055a15 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853719.724876:0:14401:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb055a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb055a15 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853719.724889:0:14401:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787853719.724917:0:14401:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb055a0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb055a15 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853719.724924:0:14401:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853719.724941:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb055a0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb055a15 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853719.724949:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9927821c6a00/0xcf1365f7cb055a0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb055a15 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853719.724965:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853719.724967:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853719.724968:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853719.724985:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642106580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3300:1874700152173952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853719.725012:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853719.725059:0:14429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522e1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14429:1874700152173824:0@lo:104: 00010000:00010000:2.0:1787853719.725077:0:14429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055a77 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853719.725306:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152173952 00000100:00100000:0.0:1787853719.725311:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152173952 00010000:00010000:0.0:1787853719.725330:0:14400:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb055a0e expref: 20 pid: 14407 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853719.725359:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787853719.725365:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642107840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+20:3300:x1874700152173952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787853719.725375:0:14400:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853719.725380:0:14400:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb055a0e expref: 20 pid: 14407 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853719.725390:0:14400:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb055a0e expref: 20 pid: 14407 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853719.725402:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992747f70000/0xcf1365f7cb055a15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb055a0e expref: 20 pid: 14407 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853719.725420:0:14400:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055a77 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853719.725429:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055a77 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787853719.725442:0:14400:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002242512s 00010000:00010000:0.0:1787853719.725446:0:14400:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055a77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853719.725453:0:14400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055a77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853719.725460:0:14400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055a77 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853719.725466:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055a77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853719.725471:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c6800 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853719.725474:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055a77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853719.725480:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055a77 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853719.725500:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055a77 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853719.725508:0:14400:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853719.725551:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642107840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:3300:x1874700152173952:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853719.725557:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787853719.725616:0:14429:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055a77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853719.725623:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055a77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853719.725628:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927821c6800/0xcf1365f7cb055a77 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853719.725709:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642106580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3300:1874700152173952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853719.750947:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+18:15811:x1874700152173696:12345-0@lo:253:mount.lustre.0 Request processed in 86459us (86569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853719.750962:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787853719.751207:0:15811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642105e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:606eab1b-a99f-4bb0-a1c7-11b5915f771c:15811:1874700152173696:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787853719.751223:0:15811:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787853719.751226:0:15811:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787853719.751228:0:15811:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787853719.751229:0:15811:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787853719.751230:0:15811:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787853719.751232:0:15811:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787853719.751233:0:15811:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787853719.751234:0:15811:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787853719.751236:0:15811:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787853719.751237:0:15811:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787853719.751255:0:15811:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787853719.756587:0:15811:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787853719.756838:0:15811:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787853719.757008:0:15811:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787853719.757629:0:15811:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787853719.758290:0:15811:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787853719.758524:0:15811:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787853719.759559:0:15811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787853719.861666:0:15811:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787853719.861700:0:15811:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787853719.861739:0:15811:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787853719.861797:0:15811:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.110@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787853719.861815:0:15811:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787853719.861859:0:15811:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787853720.394362:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787853720.715086:0:3296:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853705/real 1787853705] req@ffff992748344f00 x1874700152166912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853720 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853720.715114:0:3296:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff992748344f00 x1874700152166912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853720 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853720.715124:0:3296:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787853705/real 1787853705] req@ffff9927483470c0 x1874700152167040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853720 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853720.715135:0:3296:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9927483470c0 x1874700152167040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787853720 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787853720.715153:0:3296:0:(import.c:65:import_set_state_nolock()) ffff9927756f5000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787853720.715177:0:3296:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787853720.715181:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748344f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1874700152166912:0@lo:8:kworker.0 00000100:00080000:3.0:1787853720.715187:0:3296:0:(import.c:65:import_set_state_nolock()) ffff99277bee5000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787853720.715192:0:3296:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787853720.715195:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927483470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1874700152167040:0@lo:8:kworker.0 00000100:00080000:0.0:1787853720.716592:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853720.716600:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787853720.716603:0:37:0:(import.c:65:import_set_state_nolock()) ffff9927756f5000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787853720.716610:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 399 00000100:00100000:3.0:1787853720.716752:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3297:1874700152174080:0@lo:400:kworker.0 00000100:00100000:3.0:1787853720.716831:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787853720.716988:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787853720.716998:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9927756f5000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:0.0:1787853720.717030:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99277c78da40 x1874700152174208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787853720.717056:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787853720.717060:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787853720.717062:0:37:0:(import.c:65:import_set_state_nolock()) ffff99277bee5000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787853720.717065:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 399 00000100:00080000:0.0:1787853720.717068:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787853720.717072:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99277bee5000 using connection 192.168.206.110@tcp/0@lo 00000100:00100000:0.0:1787853720.717084:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99277c78d2c0 x1874700152174336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787853720.717142:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152174464:0@lo:400:kworker.0 00000100:00100000:0.0:1787853720.717176:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853720.717208:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152174592:0@lo:400:kworker.0 00000100:00100000:3.0:1787853720.717962:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1874700152174208:0@lo:8:kworker.0 00000100:00100000:3.0:1787853720.718005:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853720.718042:0:3296:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1874700152174336:0@lo:8:kworker.0 00000100:00100000:3.0:1787853720.718068:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853720.719175:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152174208 00000100:00100000:3.0:1787853720.719184:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152174208 00000100:00100000:3.0:1787853720.719211:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152174336 00000100:00100000:3.0:1787853720.719214:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152174336 00000100:00100000:3.0:1787853720.719242:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853720.719249:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3296:x1874700152174208:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787853720.719277:0:15094:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 415 last 0 00000020:00000080:3.0:1787853720.719304:0:15094:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf1365f7cb055a7e 00002000:00100000:3.0:1787853720.719317:0:15094:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff992746bcc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113953 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787853720.719321:0:15094:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787853720.719324:0:15094:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1787853720.720052:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853720.720088:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787853720.720097:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152174720:0@lo:400:kworker.0 00000100:00100000:0.0:1787853720.720132:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853720.720165:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152174464 00000100:00100000:0.0:1787853720.720170:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152174464 00000100:00100000:0.0:1787853720.720197:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152174592 00000100:00100000:0.0:1787853720.720201:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152174592 00000100:00100000:0.0:1787853720.720213:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152174720 00000100:00100000:0.0:1787853720.720216:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152174720 00000100:00100000:0.0:1787853720.720240:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787853720.720247:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152174464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853720.720304:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152174464:12345-0@lo:400:kworker.0 Request processed in 57us (3127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853720.720312:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787853720.720329:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787853720.720336:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152174592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853720.720369:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152174592:12345-0@lo:400:kworker.0 Request processed in 33us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853720.720375:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00002000:00080000:3.0:1787853720.720763:0:15094:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787853720.720788:0:15094:0:(import.c:65:import_set_state_nolock()) ffff992746bcc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787853720.720833:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3296:x1874700152174208:12345-0@lo:8:kworker.0 Request processed in 1583us (2827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853720.720839:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853720.720854:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787853720.720858:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3296:x1874700152174336:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787853720.720875:0:15094:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 415 last 0 00000020:00000080:3.0:1787853720.720895:0:15094:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf1365f7cb055a85 00002000:00100000:3.0:1787853720.720905:0:15094:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff992746bca800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113953 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787853720.720916:0:15094:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787853720.720919:0:15094:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787853720.721143:0:15094:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787853720.721155:0:15094:0:(import.c:65:import_set_state_nolock()) ffff992746bc8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787853720.721185:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3296:x1874700152174336:12345-0@lo:8:kworker.0 Request processed in 325us (3116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853720.721192:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787853720.721231:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277c78da40 x1874700152174208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787853740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853720.721241:0:3296:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787853720.721247:0:3296:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787853720.721253:0:3296:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787853720.721257:0:3296:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787853720.721260:0:3296:0:(import.c:65:import_set_state_nolock()) ffff9927756f5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787853720.721273:0:3296:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787853720.721277:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1874700152174208:0@lo:8:kworker.0 00010000:00080000:3.0:1787853720.721289:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277c78d2c0 x1874700152174336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787853740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787853720.721295:0:3296:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787853720.721298:0:3296:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787853720.721302:0:3296:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787853720.721305:0:3296:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787853720.721306:0:3296:0:(import.c:65:import_set_state_nolock()) ffff99277bee5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787853720.721317:0:3296:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787853720.721320:0:3296:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3296:1874700152174336:0@lo:8:kworker.0 00000004:00080000:3.0:1787853720.721344:0:14435:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787853720.721740:0:14435:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 415019066104ns, next at 0ns, rc = 0 00000004:00080000:3.0:1787853720.721760:0:14437:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787853720.721968:0:14437:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 415019294230ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787853720.723081:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152174080 00000100:00100000:1.0:1787853720.723091:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152174080 00000100:00100000:1.0:1787853720.723136:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787853720.723145:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dcaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+18:3297:x1874700152174080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853720.723219:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dcaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+18:3297:x1874700152174080:12345-0@lo:400:kworker.0 Request processed in 76us (6389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853720.723235:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787853720.723291:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3297:1874700152174080:0@lo:400:kworker.0 00000004:00080000:2.0:1787853720.726420:0:14436:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787853720.726451:0:14436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642107c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14436:1874700152174976:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787853720.726524:0:14436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853720.726570:0:14436:0:(client.c:2715:ptlrpc_set_wait()) set ffff992744018540 going to sleep for 11 seconds 00000100:00100000:2.0:1787853720.726588:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992642107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152174848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853720.726614:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853720.726697:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152174848 00000100:00100000:2.0:1787853720.726704:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152174848 00000100:00100000:2.0:1787853720.726755:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787853720.726765:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642106d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1874700152174848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853720.726798:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853720.726842:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642106d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1874700152174848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853720.726849:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787853720.726887:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992642107480 x1874700152174848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853720.726917:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642107480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152174848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787853720.726945:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152174976 00000100:00100000:2.0:1787853720.726949:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152174976 00000100:00100000:2.0:1787853720.726972:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787853720.726979:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9926421043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14436:x1874700152174976:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787853720.729571:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787853720.729611:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152174720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853720.729729:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152174720:12345-0@lo:400:kworker.0 Request processed in 141us (9596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853720.729738:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1787853720.729774:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787853720.729779:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787853720.729809:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277c78c3c0 x1874700152174464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853720.729823:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152174464:0@lo:400:kworker.0 00010000:00080000:0.0:1787853720.729853:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277c78cb40 x1874700152174720/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853720.729863:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152174720:0@lo:400:kworker.0 00010000:00080000:0.0:1787853720.729875:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277c78f480 x1874700152174592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853720.729883:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152174592:0@lo:400:kworker.0 00000004:00080000:0.0:1787853720.729965:0:14438:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1787853720.729987:0:14438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14438:1874700152175232:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787853720.730022:0:14438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853720.730042:0:14438:0:(client.c:2715:ptlrpc_set_wait()) set ffff99275178d480 going to sleep for 11 seconds 00000100:00100000:1.0:1787853720.733767:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152175104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787853720.733842:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853720.733919:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152175104 00000100:00100000:1.0:1787853720.733926:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152175104 00000100:00100000:1.0:1787853720.733976:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787853720.733985:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1874700152175104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787853720.734017:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787853720.734061:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1874700152175104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853720.734068:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787853720.734088:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787853720.734112:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277c78f480 x1874700152175104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787853736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787853720.734130:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152175104:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1787853720.740378:0:15094:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787853720.740389:0:15094:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1787853720.740395:0:15094:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00100000:3.0:1787853720.740929:0:15096:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787853720.740940:0:15096:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787853720.741419:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152175232 00000100:00100000:3.0:1787853720.741428:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152175232 00000100:00100000:3.0:1787853720.741953:0:15879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787853720.741964:0:15879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14438:x1874700152175232:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787853720.753002:0:15879:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787853720.753014:0:15879:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787853720.753019:0:15879:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1787853720.762824:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.762836:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb055a8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.762851:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.762856:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.762871:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb055a8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.762887:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb055a8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.762912:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb055a8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.762922:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb055a8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.762940:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787853720.763382:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.763388:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ff497ac/0xcf1365f7cb055a93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.763398:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.763400:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.763404:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ff497ac/0xcf1365f7cb055a93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.763413:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ff497ac/0xcf1365f7cb055a93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.763421:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ff497ac/0xcf1365f7cb055a93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.763439:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ff497ac/0xcf1365f7cb055a93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.763456:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787853720.763471:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853720.763477:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb055a8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.763484:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71a00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.763488:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb055a8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.765581:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb055a8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.765614:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb055a8c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.765623:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005865485/0xcf1365f7cb055a8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.765724:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.765728:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ff497ac/0xcf1365f7cb055a93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.765748:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71200 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.765751:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ff497ac/0xcf1365f7cb055a93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.765759:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ff497ac/0xcf1365f7cb055a93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.765770:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ff497ac/0xcf1365f7cb055a93 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.765776:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ff497ac/0xcf1365f7cb055a93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.765787:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.765789:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.765792:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.766041:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.770399:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.770411:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034748a21/0xcf1365f7cb055a9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.770428:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.770433:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.770439:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034748a21/0xcf1365f7cb055a9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.770465:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034748a21/0xcf1365f7cb055a9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.770476:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034748a21/0xcf1365f7cb055a9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.770484:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034748a21/0xcf1365f7cb055a9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.770503:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853720.770516:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.770522:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034748a21/0xcf1365f7cb055a9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.770529:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70000 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.770533:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034748a21/0xcf1365f7cb055a9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.770541:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034748a21/0xcf1365f7cb055a9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.770556:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034748a21/0xcf1365f7cb055a9a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.770564:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034748a21/0xcf1365f7cb055a9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.770589:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.770591:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.770592:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.771622:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.771641:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eb094bc/0xcf1365f7cb055aa1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.771653:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.771656:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.771661:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006eb094bc/0xcf1365f7cb055aa1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.772023:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006eb094bc/0xcf1365f7cb055aa1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.772036:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eb094bc/0xcf1365f7cb055aa1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.772043:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006eb094bc/0xcf1365f7cb055aa1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.772073:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787853720.772583:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.772590:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb055aa8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.772609:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.772613:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.772617:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb055aa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.772800:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853720.772808:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006eb094bc/0xcf1365f7cb055aa1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.772816:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71c00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853720.772821:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006eb094bc/0xcf1365f7cb055aa1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.772829:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006eb094bc/0xcf1365f7cb055aa1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.772848:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006eb094bc/0xcf1365f7cb055aa1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.772862:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eb094bc/0xcf1365f7cb055aa1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.772882:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.772883:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.772885:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.773001:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb055aa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.773010:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb055aa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.773017:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb055aa8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.775989:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787853720.777006:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.777016:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000515c327/0xcf1365f7cb055aaf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.777031:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.777036:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.777043:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000515c327/0xcf1365f7cb055aaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.777056:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000515c327/0xcf1365f7cb055aaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.777077:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000515c327/0xcf1365f7cb055aaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.777083:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000515c327/0xcf1365f7cb055aaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.777219:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787853720.777227:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb055aa8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.777245:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70c00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853720.777249:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb055aa8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.777257:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb055aa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.777273:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb055aa8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.777280:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072ab78fc/0xcf1365f7cb055aa8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.777296:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853720.777300:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000515c327/0xcf1365f7cb055aaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.777306:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f70e00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853720.777310:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000515c327/0xcf1365f7cb055aaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.777317:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000515c327/0xcf1365f7cb055aaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.777326:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000515c327/0xcf1365f7cb055aaf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.777340:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.777342:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.777344:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.777494:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787853720.777500:0:15094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000515c327/0xcf1365f7cb055aaf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787853720.778100:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.778107:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bea25ad/0xcf1365f7cb055ab6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.778115:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.778119:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.778123:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bea25ad/0xcf1365f7cb055ab6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.778132:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bea25ad/0xcf1365f7cb055ab6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.778139:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bea25ad/0xcf1365f7cb055ab6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.778154:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bea25ad/0xcf1365f7cb055ab6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.780743:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853720.780756:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bea25ad/0xcf1365f7cb055ab6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.780771:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318f400 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853720.780775:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bea25ad/0xcf1365f7cb055ab6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.780785:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bea25ad/0xcf1365f7cb055ab6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.780804:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bea25ad/0xcf1365f7cb055ab6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.780813:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.780815:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.780817:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.781654:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787853720.781663:0:15094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bea25ad/0xcf1365f7cb055ab6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787853720.782478:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.782487:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040788d30/0xcf1365f7cb055abd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.782499:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.782504:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.782510:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040788d30/0xcf1365f7cb055abd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.782522:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040788d30/0xcf1365f7cb055abd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.782532:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040788d30/0xcf1365f7cb055abd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.782540:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040788d30/0xcf1365f7cb055abd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.785995:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853720.786015:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.786022:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040788d30/0xcf1365f7cb055abd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.786035:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318e000 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.786039:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040788d30/0xcf1365f7cb055abd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.786049:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040788d30/0xcf1365f7cb055abd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.786068:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040788d30/0xcf1365f7cb055abd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.786077:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040788d30/0xcf1365f7cb055abd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.786099:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.786100:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.786102:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.786612:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.786620:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076bf771e/0xcf1365f7cb055ac4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.786797:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.787771:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.787782:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.787789:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076bf771e/0xcf1365f7cb055ac4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.787804:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076bf771e/0xcf1365f7cb055ac4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.787814:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076bf771e/0xcf1365f7cb055ac4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.787820:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076bf771e/0xcf1365f7cb055ac4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.787872:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787853720.788563:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.788571:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ce8b043/0xcf1365f7cb055acb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.788582:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.788585:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.788590:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ce8b043/0xcf1365f7cb055acb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.788599:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ce8b043/0xcf1365f7cb055acb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.788608:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ce8b043/0xcf1365f7cb055acb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.788621:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ce8b043/0xcf1365f7cb055acb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787853720.790724:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.790735:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb055ad2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.790748:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.790753:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.790758:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb055ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.790774:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb055ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.790785:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb055ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.790792:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb055ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.791419:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787853720.791429:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076bf771e/0xcf1365f7cb055ac4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.791439:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318f200 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853720.791451:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076bf771e/0xcf1365f7cb055ac4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.791462:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076bf771e/0xcf1365f7cb055ac4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.791479:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076bf771e/0xcf1365f7cb055ac4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.791487:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076bf771e/0xcf1365f7cb055ac4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.791734:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787853720.791749:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853720.791754:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ce8b043/0xcf1365f7cb055acb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.791762:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318ea00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.791765:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce8b043/0xcf1365f7cb055acb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.791773:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce8b043/0xcf1365f7cb055acb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.791784:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ce8b043/0xcf1365f7cb055acb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.791791:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ce8b043/0xcf1365f7cb055acb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.791807:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.791811:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb055ad2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.791829:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c6800 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.791832:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb055ad2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.791840:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb055ad2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.791854:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb055ad2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.791862:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.791863:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.791865:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.792622:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.793283:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.793287:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.796113:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.796126:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e91b93a8/0xcf1365f7cb055ad9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.796144:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.796149:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.796156:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e91b93a8/0xcf1365f7cb055ad9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.796172:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e91b93a8/0xcf1365f7cb055ad9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.796183:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e91b93a8/0xcf1365f7cb055ad9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.796199:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e91b93a8/0xcf1365f7cb055ad9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.796218:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853720.796232:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.796238:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e91b93a8/0xcf1365f7cb055ad9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.796246:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318f800 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.796251:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e91b93a8/0xcf1365f7cb055ad9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.796261:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e91b93a8/0xcf1365f7cb055ad9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.796277:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e91b93a8/0xcf1365f7cb055ad9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.796286:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e91b93a8/0xcf1365f7cb055ad9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.796304:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.796306:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.796308:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.796830:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.796844:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e02d2455/0xcf1365f7cb055ae0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.796853:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.796857:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.796861:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e02d2455/0xcf1365f7cb055ae0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.796870:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e02d2455/0xcf1365f7cb055ae0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.796878:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e02d2455/0xcf1365f7cb055ae0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.796885:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e02d2455/0xcf1365f7cb055ae0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.799015:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787853720.801328:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853720.801330:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.801345:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e02d2455/0xcf1365f7cb055ae0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.801346:0:15879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb055ad2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.801371:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318fa00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.801378:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e02d2455/0xcf1365f7cb055ae0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.801391:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e02d2455/0xcf1365f7cb055ae0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.801425:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e02d2455/0xcf1365f7cb055ae0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.801433:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e02d2455/0xcf1365f7cb055ae0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.801452:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.801454:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.801456:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.802190:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.802198:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075876e53/0xcf1365f7cb055ae7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.802211:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.802216:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.802223:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075876e53/0xcf1365f7cb055ae7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.802236:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075876e53/0xcf1365f7cb055ae7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.802246:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075876e53/0xcf1365f7cb055ae7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.802255:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075876e53/0xcf1365f7cb055ae7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.802285:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853720.802299:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.802304:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075876e53/0xcf1365f7cb055ae7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.802312:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318e200 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.802316:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075876e53/0xcf1365f7cb055ae7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.802326:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075876e53/0xcf1365f7cb055ae7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.802342:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075876e53/0xcf1365f7cb055ae7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.802349:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075876e53/0xcf1365f7cb055ae7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.802369:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.802373:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.802375:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.804231:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853720.805217:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.805227:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004506be3e/0xcf1365f7cb055aee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.805242:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.805247:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.805253:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004506be3e/0xcf1365f7cb055aee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.805267:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004506be3e/0xcf1365f7cb055aee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.805279:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004506be3e/0xcf1365f7cb055aee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.805287:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004506be3e/0xcf1365f7cb055aee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.805312:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853720.806014:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.806023:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004506be3e/0xcf1365f7cb055aee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806033:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c7800 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.806044:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004506be3e/0xcf1365f7cb055aee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806053:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004506be3e/0xcf1365f7cb055aee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806070:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004506be3e/0xcf1365f7cb055aee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806077:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004506be3e/0xcf1365f7cb055aee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806100:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.806103:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.806105:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.806144:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.806150:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f46273/0xcf1365f7cb055af5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806159:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.806162:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.806167:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f46273/0xcf1365f7cb055af5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806178:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069f46273/0xcf1365f7cb055af5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806186:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f46273/0xcf1365f7cb055af5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806200:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069f46273/0xcf1365f7cb055af5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806217:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853720.806226:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.806230:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069f46273/0xcf1365f7cb055af5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806237:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318e400 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.806240:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f46273/0xcf1365f7cb055af5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806247:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f46273/0xcf1365f7cb055af5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806257:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069f46273/0xcf1365f7cb055af5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806265:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069f46273/0xcf1365f7cb055af5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806280:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.806282:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.806284:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853720.806711:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.806723:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7a36f84/0xcf1365f7cb055afc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.806739:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.806743:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.806747:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7a36f84/0xcf1365f7cb055afc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.806758:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7a36f84/0xcf1365f7cb055afc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.806766:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7a36f84/0xcf1365f7cb055afc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.806774:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7a36f84/0xcf1365f7cb055afc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787853720.806787:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.806794:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853720.806804:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddd03105/0xcf1365f7cb055b03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806813:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.806817:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.806822:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddd03105/0xcf1365f7cb055b03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806832:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddd03105/0xcf1365f7cb055b03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806840:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddd03105/0xcf1365f7cb055b03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806847:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddd03105/0xcf1365f7cb055b03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806861:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.806865:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7a36f84/0xcf1365f7cb055afc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806873:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c6c00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.806877:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7a36f84/0xcf1365f7cb055afc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.806885:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7a36f84/0xcf1365f7cb055afc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.807975:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7a36f84/0xcf1365f7cb055afc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.807984:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7a36f84/0xcf1365f7cb055afc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.808003:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.808005:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.808007:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.808021:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853720.808031:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.808035:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddd03105/0xcf1365f7cb055b03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.808042:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318fc00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.808045:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddd03105/0xcf1365f7cb055b03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.808053:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddd03105/0xcf1365f7cb055b03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.808063:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddd03105/0xcf1365f7cb055b03 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.808070:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddd03105/0xcf1365f7cb055b03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.808098:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.808100:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.808101:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.808729:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.808737:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040788d30/0xcf1365f7cb055b0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.808747:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.808752:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.808757:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040788d30/0xcf1365f7cb055b0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.808768:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040788d30/0xcf1365f7cb055b0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.808776:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040788d30/0xcf1365f7cb055b0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.808783:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040788d30/0xcf1365f7cb055b0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.808797:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853720.808807:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.808811:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040788d30/0xcf1365f7cb055b0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.808828:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318e000 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.808832:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040788d30/0xcf1365f7cb055b0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.808840:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040788d30/0xcf1365f7cb055b0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.808852:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040788d30/0xcf1365f7cb055b0a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.808859:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040788d30/0xcf1365f7cb055b0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.808874:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.808876:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.808877:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.809310:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.809316:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bea25ad/0xcf1365f7cb055b11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.809325:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.809329:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.809333:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bea25ad/0xcf1365f7cb055b11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.809341:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bea25ad/0xcf1365f7cb055b11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.809357:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bea25ad/0xcf1365f7cb055b11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.809364:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bea25ad/0xcf1365f7cb055b11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.809378:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853720.809387:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.809391:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bea25ad/0xcf1365f7cb055b11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.809396:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318f400 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.809399:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bea25ad/0xcf1365f7cb055b11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.809406:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bea25ad/0xcf1365f7cb055b11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.809417:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bea25ad/0xcf1365f7cb055b11 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.809424:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bea25ad/0xcf1365f7cb055b11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.809438:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.809445:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.809447:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.809839:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.809845:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001afa9c8a/0xcf1365f7cb055b18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.809853:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.809856:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.809861:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001afa9c8a/0xcf1365f7cb055b18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.809870:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001afa9c8a/0xcf1365f7cb055b18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.809878:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001afa9c8a/0xcf1365f7cb055b18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.809885:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001afa9c8a/0xcf1365f7cb055b18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.809897:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853720.809905:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.809908:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001afa9c8a/0xcf1365f7cb055b18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.809914:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318ec00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.809917:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001afa9c8a/0xcf1365f7cb055b18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.809936:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001afa9c8a/0xcf1365f7cb055b18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.809946:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001afa9c8a/0xcf1365f7cb055b18 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.809953:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001afa9c8a/0xcf1365f7cb055b18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.809966:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.809968:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.809969:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.810313:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.810318:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000675fd98e/0xcf1365f7cb055b1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.810326:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.810329:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.810333:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000675fd98e/0xcf1365f7cb055b1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.810341:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000675fd98e/0xcf1365f7cb055b1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.810349:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000675fd98e/0xcf1365f7cb055b1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.810362:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000675fd98e/0xcf1365f7cb055b1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.810374:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853720.810382:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.810386:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000675fd98e/0xcf1365f7cb055b1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.810392:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318e800 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.810395:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000675fd98e/0xcf1365f7cb055b1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.810402:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000675fd98e/0xcf1365f7cb055b1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.810412:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000675fd98e/0xcf1365f7cb055b1f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.810419:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000675fd98e/0xcf1365f7cb055b1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.810433:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.810434:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.810436:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.811341:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.811356:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de1f5dfc/0xcf1365f7cb055b26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.811367:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.811370:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.811375:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de1f5dfc/0xcf1365f7cb055b26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.811386:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de1f5dfc/0xcf1365f7cb055b26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.811394:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de1f5dfc/0xcf1365f7cb055b26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.811400:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de1f5dfc/0xcf1365f7cb055b26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.811418:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853720.811430:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.811434:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de1f5dfc/0xcf1365f7cb055b26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.811441:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318fe00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.811444:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de1f5dfc/0xcf1365f7cb055b26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.811451:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de1f5dfc/0xcf1365f7cb055b26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.811472:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de1f5dfc/0xcf1365f7cb055b26 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.811479:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de1f5dfc/0xcf1365f7cb055b26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.811494:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.811496:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.811498:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853720.816270:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.816284:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ad079f9/0xcf1365f7cb055b2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.816299:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.816304:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.816310:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ad079f9/0xcf1365f7cb055b2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.816324:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ad079f9/0xcf1365f7cb055b2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.816348:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ad079f9/0xcf1365f7cb055b2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.816356:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ad079f9/0xcf1365f7cb055b2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.816384:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787853720.817074:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.817081:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0f64455/0xcf1365f7cb055b34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.817090:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.817093:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.817097:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0f64455/0xcf1365f7cb055b34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.817106:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0f64455/0xcf1365f7cb055b34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.817113:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0f64455/0xcf1365f7cb055b34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.817120:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0f64455/0xcf1365f7cb055b34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.817144:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787853720.817821:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.817828:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005401650d/0xcf1365f7cb055b3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.817838:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.817841:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.817846:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005401650d/0xcf1365f7cb055b3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.817856:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005401650d/0xcf1365f7cb055b3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.817864:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005401650d/0xcf1365f7cb055b3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.817871:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005401650d/0xcf1365f7cb055b3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.817915:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787853720.818073:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787853720.818083:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ad079f9/0xcf1365f7cb055b2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818094:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c6a00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.818099:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ad079f9/0xcf1365f7cb055b2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818109:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ad079f9/0xcf1365f7cb055b2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818125:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ad079f9/0xcf1365f7cb055b2d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818132:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ad079f9/0xcf1365f7cb055b2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818170:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853720.818174:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0f64455/0xcf1365f7cb055b34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818181:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c7c00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.818184:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0f64455/0xcf1365f7cb055b34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818191:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0f64455/0xcf1365f7cb055b34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818202:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0f64455/0xcf1365f7cb055b34 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818208:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0f64455/0xcf1365f7cb055b34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818220:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.818223:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005401650d/0xcf1365f7cb055b3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818229:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821fc200 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.818233:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005401650d/0xcf1365f7cb055b3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818251:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005401650d/0xcf1365f7cb055b3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818262:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005401650d/0xcf1365f7cb055b3b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818268:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005401650d/0xcf1365f7cb055b3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818283:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.818285:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.818287:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.818296:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.818507:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.818513:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c17e98e5/0xcf1365f7cb055b42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818521:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.818524:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.818529:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c17e98e5/0xcf1365f7cb055b42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818538:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c17e98e5/0xcf1365f7cb055b42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818546:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c17e98e5/0xcf1365f7cb055b42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818560:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c17e98e5/0xcf1365f7cb055b42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818572:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853720.818581:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.818584:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c17e98e5/0xcf1365f7cb055b42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818590:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318f000 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.818593:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c17e98e5/0xcf1365f7cb055b42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818600:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c17e98e5/0xcf1365f7cb055b42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818611:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c17e98e5/0xcf1365f7cb055b42 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818617:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c17e98e5/0xcf1365f7cb055b42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.818646:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.818648:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.818649:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853720.818963:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.818969:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001857d7d1/0xcf1365f7cb055b49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.818978:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.818988:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.818993:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001857d7d1/0xcf1365f7cb055b49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.819005:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001857d7d1/0xcf1365f7cb055b49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.819014:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001857d7d1/0xcf1365f7cb055b49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.819022:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001857d7d1/0xcf1365f7cb055b49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.819041:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853720.819579:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.819585:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001857d7d1/0xcf1365f7cb055b49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.827120:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821fda00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.827127:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001857d7d1/0xcf1365f7cb055b49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.827137:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001857d7d1/0xcf1365f7cb055b49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.827158:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001857d7d1/0xcf1365f7cb055b49 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.827166:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001857d7d1/0xcf1365f7cb055b49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.827191:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.827193:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.827195:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.827639:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.827646:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e91b93a8/0xcf1365f7cb055b50 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.827658:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.827662:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.827668:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e91b93a8/0xcf1365f7cb055b50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.827702:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e91b93a8/0xcf1365f7cb055b50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.827717:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e91b93a8/0xcf1365f7cb055b50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.827724:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e91b93a8/0xcf1365f7cb055b50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.827744:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853720.827755:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.827760:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e91b93a8/0xcf1365f7cb055b50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.827767:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318f800 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.827771:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e91b93a8/0xcf1365f7cb055b50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.827778:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e91b93a8/0xcf1365f7cb055b50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.827790:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e91b93a8/0xcf1365f7cb055b50 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.827797:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e91b93a8/0xcf1365f7cb055b50 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.827812:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.827819:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.827821:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853720.831388:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.831403:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040cae852/0xcf1365f7cb055b57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.831418:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.831422:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.831428:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040cae852/0xcf1365f7cb055b57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.831441:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040cae852/0xcf1365f7cb055b57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.831452:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040cae852/0xcf1365f7cb055b57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.831467:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040cae852/0xcf1365f7cb055b57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.831491:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853720.832024:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.832032:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040cae852/0xcf1365f7cb055b57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832042:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821fde00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.832046:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040cae852/0xcf1365f7cb055b57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832055:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040cae852/0xcf1365f7cb055b57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832072:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040cae852/0xcf1365f7cb055b57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832078:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040cae852/0xcf1365f7cb055b57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832094:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.832096:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.832097:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.832140:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.832146:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddd03105/0xcf1365f7cb055b5e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832155:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.832159:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.832170:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddd03105/0xcf1365f7cb055b5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832180:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddd03105/0xcf1365f7cb055b5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832187:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddd03105/0xcf1365f7cb055b5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832194:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddd03105/0xcf1365f7cb055b5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832208:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853720.832218:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.832222:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddd03105/0xcf1365f7cb055b5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832229:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318fc00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.832232:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddd03105/0xcf1365f7cb055b5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832240:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddd03105/0xcf1365f7cb055b5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832250:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddd03105/0xcf1365f7cb055b5e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832270:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddd03105/0xcf1365f7cb055b5e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832284:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.832286:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.832287:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.832781:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.832787:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f46273/0xcf1365f7cb055b65 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832795:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.832799:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.832803:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f46273/0xcf1365f7cb055b65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832811:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069f46273/0xcf1365f7cb055b65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832818:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f46273/0xcf1365f7cb055b65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832825:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069f46273/0xcf1365f7cb055b65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832838:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853720.832846:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.832855:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069f46273/0xcf1365f7cb055b65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832862:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318e400 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.832865:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f46273/0xcf1365f7cb055b65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832873:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f46273/0xcf1365f7cb055b65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832883:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069f46273/0xcf1365f7cb055b65 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.832891:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069f46273/0xcf1365f7cb055b65 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787853720.834470:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.834479:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008839b5c2/0xcf1365f7cb055b6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.834491:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.834495:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.834501:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008839b5c2/0xcf1365f7cb055b6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.835150:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.835153:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.835155:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853720.835747:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008839b5c2/0xcf1365f7cb055b6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.835759:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008839b5c2/0xcf1365f7cb055b6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.835766:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008839b5c2/0xcf1365f7cb055b6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.835793:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853720.835874:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853720.835882:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008839b5c2/0xcf1365f7cb055b6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.835891:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821fcc00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853720.835906:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008839b5c2/0xcf1365f7cb055b6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.835918:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008839b5c2/0xcf1365f7cb055b6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.835937:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008839b5c2/0xcf1365f7cb055b6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.835952:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008839b5c2/0xcf1365f7cb055b6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.835973:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.835976:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.835978:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853720.838016:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.838030:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6a39aca/0xcf1365f7cb055b73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.838056:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.838060:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.838068:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a39aca/0xcf1365f7cb055b73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.838083:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6a39aca/0xcf1365f7cb055b73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.838092:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6a39aca/0xcf1365f7cb055b73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.838100:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a39aca/0xcf1365f7cb055b73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.838118:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787853720.838147:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1787853720.838164:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1787853720.838182:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.838189:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6a39aca/0xcf1365f7cb055b73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.838199:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821fdc00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.838203:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6a39aca/0xcf1365f7cb055b73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.838223:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6a39aca/0xcf1365f7cb055b73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.838242:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6a39aca/0xcf1365f7cb055b73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.838249:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6a39aca/0xcf1365f7cb055b73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.838269:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.838271:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.838272:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.840084:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.840096:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c17e98e5/0xcf1365f7cb055b7a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.840108:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.840112:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.840118:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c17e98e5/0xcf1365f7cb055b7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.840129:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c17e98e5/0xcf1365f7cb055b7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.840138:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c17e98e5/0xcf1365f7cb055b7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.840157:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c17e98e5/0xcf1365f7cb055b7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.840182:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787853720.840749:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.840756:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de1f5dfc/0xcf1365f7cb055b81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.840765:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.840769:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.840773:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de1f5dfc/0xcf1365f7cb055b81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.840783:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de1f5dfc/0xcf1365f7cb055b81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.840791:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de1f5dfc/0xcf1365f7cb055b81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.840798:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de1f5dfc/0xcf1365f7cb055b81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.840815:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787853720.840830:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853720.840837:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c17e98e5/0xcf1365f7cb055b7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.840850:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318f000 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.840855:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c17e98e5/0xcf1365f7cb055b7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.840863:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c17e98e5/0xcf1365f7cb055b7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.840880:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c17e98e5/0xcf1365f7cb055b7a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.840887:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c17e98e5/0xcf1365f7cb055b7a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787853720.841089:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.841096:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c9fd91/0xcf1365f7cb055b88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.841105:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.841108:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.841112:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c9fd91/0xcf1365f7cb055b88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.841121:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048c9fd91/0xcf1365f7cb055b88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.841139:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048c9fd91/0xcf1365f7cb055b88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.841146:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048c9fd91/0xcf1365f7cb055b88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.841154:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787853720.842002:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853720.842009:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de1f5dfc/0xcf1365f7cb055b81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.842017:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318fe00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.842021:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de1f5dfc/0xcf1365f7cb055b81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.842029:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de1f5dfc/0xcf1365f7cb055b81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.842042:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de1f5dfc/0xcf1365f7cb055b81 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.842056:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de1f5dfc/0xcf1365f7cb055b81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.842071:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.842074:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048c9fd91/0xcf1365f7cb055b88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.842081:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821fc800 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.842084:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c9fd91/0xcf1365f7cb055b88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.842091:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c9fd91/0xcf1365f7cb055b88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.842101:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048c9fd91/0xcf1365f7cb055b88 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.842108:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c9fd91/0xcf1365f7cb055b88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.842125:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.842128:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.842130:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853720.842467:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.842474:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ff4eef6/0xcf1365f7cb055b8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.842484:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.842487:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.842492:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ff4eef6/0xcf1365f7cb055b8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.842502:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ff4eef6/0xcf1365f7cb055b8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.842762:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ff4eef6/0xcf1365f7cb055b8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.842771:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ff4eef6/0xcf1365f7cb055b8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.842809:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787853720.843818:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.843827:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006296f4a1/0xcf1365f7cb055b96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.843838:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.843841:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.843846:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006296f4a1/0xcf1365f7cb055b96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.843857:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006296f4a1/0xcf1365f7cb055b96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.843865:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006296f4a1/0xcf1365f7cb055b96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.843872:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006296f4a1/0xcf1365f7cb055b96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.843880:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787853720.844822:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853720.844831:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ff4eef6/0xcf1365f7cb055b8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.844847:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821fd000 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.844852:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ff4eef6/0xcf1365f7cb055b8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.844861:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ff4eef6/0xcf1365f7cb055b8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.844878:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ff4eef6/0xcf1365f7cb055b8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.844886:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ff4eef6/0xcf1365f7cb055b8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.844976:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.844979:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006296f4a1/0xcf1365f7cb055b96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.844986:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821fc400 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.844988:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006296f4a1/0xcf1365f7cb055b96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.844995:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006296f4a1/0xcf1365f7cb055b96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.845005:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006296f4a1/0xcf1365f7cb055b96 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.845018:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006296f4a1/0xcf1365f7cb055b96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.845031:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.845033:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.845034:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.845095:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.845100:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000675fd98e/0xcf1365f7cb055b9d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.845108:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.845112:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.845116:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000675fd98e/0xcf1365f7cb055b9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.845125:0:15094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000675fd98e/0xcf1365f7cb055b9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.845132:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000675fd98e/0xcf1365f7cb055b9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.845139:0:15094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000675fd98e/0xcf1365f7cb055b9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.845156:0:15094:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787853720.845163:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853720.845171:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000675fd98e/0xcf1365f7cb055b9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.845177:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318e800 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853720.845181:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000675fd98e/0xcf1365f7cb055b9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.845188:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000675fd98e/0xcf1365f7cb055b9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.845198:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000675fd98e/0xcf1365f7cb055b9d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.845205:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000675fd98e/0xcf1365f7cb055b9d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.845219:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.845220:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.845222:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853720.845460:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.845467:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9f04e43/0xcf1365f7cb055ba4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.845476:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.845486:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.845491:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9f04e43/0xcf1365f7cb055ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.845502:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9f04e43/0xcf1365f7cb055ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.845571:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9f04e43/0xcf1365f7cb055ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.845578:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9f04e43/0xcf1365f7cb055ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.845596:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853720.846192:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853720.846199:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9f04e43/0xcf1365f7cb055ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.846208:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821fd800 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853720.846212:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9f04e43/0xcf1365f7cb055ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.846219:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9f04e43/0xcf1365f7cb055ba4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.846232:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9f04e43/0xcf1365f7cb055ba4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.846240:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9f04e43/0xcf1365f7cb055ba4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.846257:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.846258:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.846260:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853720.846709:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787853720.846876:0:15094:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1787853720.847156:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9926421043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14436:x1874700152174976:12345-0@lo:5:osp-pre-0-0.0 Request processed in 120173us (120627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853720.847166:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787853720.847257:0:14436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992642107c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14436:1874700152174976:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787853720.847272:0:14436:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1787853720.847317:0:14436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78cf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14436:1874700152175360:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787853720.847356:0:14436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853720.847407:0:14436:0:(client.c:2715:ptlrpc_set_wait()) set ffff992744ef40c0 going to sleep for 11 seconds 00002000:00010000:3.0:1787853720.847423:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.847431:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040cae852/0xcf1365f7cb055bab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.847443:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.847448:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.847454:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040cae852/0xcf1365f7cb055bab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.847466:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040cae852/0xcf1365f7cb055bab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.847476:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040cae852/0xcf1365f7cb055bab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.847491:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040cae852/0xcf1365f7cb055bab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.847525:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853720.847722:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853720.847728:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040cae852/0xcf1365f7cb055bab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.847736:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821fde00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853720.847740:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040cae852/0xcf1365f7cb055bab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.847750:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040cae852/0xcf1365f7cb055bab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.847764:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040cae852/0xcf1365f7cb055bab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.847772:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040cae852/0xcf1365f7cb055bab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.847789:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.847791:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.847792:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853720.848003:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.848009:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001857d7d1/0xcf1365f7cb055bb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.848018:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.848022:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.848026:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001857d7d1/0xcf1365f7cb055bb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.848036:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001857d7d1/0xcf1365f7cb055bb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.848044:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001857d7d1/0xcf1365f7cb055bb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.848052:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001857d7d1/0xcf1365f7cb055bb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.848075:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853720.848743:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853720.848755:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001857d7d1/0xcf1365f7cb055bb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.848765:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821fda00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853720.848768:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001857d7d1/0xcf1365f7cb055bb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.848778:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001857d7d1/0xcf1365f7cb055bb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.848790:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001857d7d1/0xcf1365f7cb055bb2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.848797:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001857d7d1/0xcf1365f7cb055bb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.848813:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.848815:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.848817:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853720.848886:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152175360 00000100:00100000:2.0:1787853720.848969:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152175360 00000100:00100000:2.0:1787853720.849022:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787853720.849032:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14436:x1874700152175360:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787853720.849077:0:15096:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00002000:00010000:3.0:1787853720.849968:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.849976:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005401650d/0xcf1365f7cb055bb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.849993:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.849997:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.850003:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005401650d/0xcf1365f7cb055bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.850015:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005401650d/0xcf1365f7cb055bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.850023:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005401650d/0xcf1365f7cb055bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.850030:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005401650d/0xcf1365f7cb055bb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.850054:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853720.850771:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853720.850778:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005401650d/0xcf1365f7cb055bb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.850788:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821fc200 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853720.850792:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005401650d/0xcf1365f7cb055bb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.850813:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005401650d/0xcf1365f7cb055bb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.850829:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005401650d/0xcf1365f7cb055bb9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.850836:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005401650d/0xcf1365f7cb055bb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.850857:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.850860:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.850861:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853720.851887:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.851896:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0f64455/0xcf1365f7cb055bc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.851907:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.851911:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.851916:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0f64455/0xcf1365f7cb055bc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.851928:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0f64455/0xcf1365f7cb055bc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.851948:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0f64455/0xcf1365f7cb055bc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.851955:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0f64455/0xcf1365f7cb055bc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.851975:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853720.852009:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853720.852016:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0f64455/0xcf1365f7cb055bc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.852025:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c7c00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:1.0:1787853720.852029:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0f64455/0xcf1365f7cb055bc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.852037:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0f64455/0xcf1365f7cb055bc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.852060:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0f64455/0xcf1365f7cb055bc0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.852067:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0f64455/0xcf1365f7cb055bc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.852085:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853720.852088:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853720.852089:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853720.853226:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.854129:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ad079f9/0xcf1365f7cb055bc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.854142:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.854146:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.854153:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ad079f9/0xcf1365f7cb055bc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.854168:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ad079f9/0xcf1365f7cb055bc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.854190:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ad079f9/0xcf1365f7cb055bc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.854200:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ad079f9/0xcf1365f7cb055bc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.854242:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853720.854735:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853720.854743:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ad079f9/0xcf1365f7cb055bc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.854753:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c6a00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:1.0:1787853720.854758:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ad079f9/0xcf1365f7cb055bc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.854767:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ad079f9/0xcf1365f7cb055bc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.854785:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ad079f9/0xcf1365f7cb055bc7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.854793:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ad079f9/0xcf1365f7cb055bc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.854833:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853720.854836:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853720.854839:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853720.854931:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.854937:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7a36f84/0xcf1365f7cb055bce lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.854946:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.854950:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.854954:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7a36f84/0xcf1365f7cb055bce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.854963:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7a36f84/0xcf1365f7cb055bce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.854971:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7a36f84/0xcf1365f7cb055bce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.854979:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7a36f84/0xcf1365f7cb055bce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.855000:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853720.855740:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853720.855746:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7a36f84/0xcf1365f7cb055bce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.855754:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c6c00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:1.0:1787853720.855757:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7a36f84/0xcf1365f7cb055bce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.855765:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7a36f84/0xcf1365f7cb055bce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.855777:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7a36f84/0xcf1365f7cb055bce lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.855784:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7a36f84/0xcf1365f7cb055bce lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.855800:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853720.855802:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853720.855804:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853720.858645:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.858657:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004506be3e/0xcf1365f7cb055bd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.858687:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.858698:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.858704:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004506be3e/0xcf1365f7cb055bd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.858718:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004506be3e/0xcf1365f7cb055bd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.858729:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004506be3e/0xcf1365f7cb055bd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.858738:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004506be3e/0xcf1365f7cb055bd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.858767:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853720.858796:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853720.858805:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004506be3e/0xcf1365f7cb055bd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.858816:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c7800 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853720.858820:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004506be3e/0xcf1365f7cb055bd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.858829:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004506be3e/0xcf1365f7cb055bd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.858846:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004506be3e/0xcf1365f7cb055bd5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.858866:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004506be3e/0xcf1365f7cb055bd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.858890:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.858892:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.858966:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853720.859262:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.859269:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb055bdc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.859280:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.859284:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.859288:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb055bdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.859299:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb055bdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.859309:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb055bdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.859324:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb055bdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.859349:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853720.859729:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853720.859735:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb055bdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.859743:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927821c6800 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853720.859747:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb055bdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.859754:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb055bdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.859768:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb055bdc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.859774:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7d4b3a2/0xcf1365f7cb055bdc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.859792:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.859796:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.859798:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853720.859916:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.859922:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000789e97a8/0xcf1365f7cb055be3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.859931:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.859934:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.859938:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000789e97a8/0xcf1365f7cb055be3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.859948:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000789e97a8/0xcf1365f7cb055be3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.859955:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000789e97a8/0xcf1365f7cb055be3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.859963:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000789e97a8/0xcf1365f7cb055be3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.861860:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787853720.862723:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853720.862733:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000789e97a8/0xcf1365f7cb055be3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.862745:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992641dafc00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853720.862750:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000789e97a8/0xcf1365f7cb055be3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.862761:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000789e97a8/0xcf1365f7cb055be3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.862778:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000789e97a8/0xcf1365f7cb055be3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.862786:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000789e97a8/0xcf1365f7cb055be3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.862812:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.862814:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.862817:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787853720.862935:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787853720.862942:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d19d07ce/0xcf1365f7cb055bea lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.862958:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787853720.862962:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853720.862968:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d19d07ce/0xcf1365f7cb055bea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.862980:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d19d07ce/0xcf1365f7cb055bea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.862989:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d19d07ce/0xcf1365f7cb055bea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.862996:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d19d07ce/0xcf1365f7cb055bea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.863018:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787853720.863435:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14436:x1874700152175360:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14400us (16075us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787853720.863444:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787853720.863499:0:14436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78cf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14436:1874700152175360:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787853720.863515:0:14436:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1787853720.863997:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787853720.864004:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d19d07ce/0xcf1365f7cb055bea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.864018:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992641daec00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853720.864022:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d19d07ce/0xcf1365f7cb055bea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.864041:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d19d07ce/0xcf1365f7cb055bea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.864056:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d19d07ce/0xcf1365f7cb055bea lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.864063:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d19d07ce/0xcf1365f7cb055bea lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853720.864078:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.864079:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787853720.864081:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.865002:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.865012:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e91b93a8/0xcf1365f7cb055bf1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.865024:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.865133:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.865143:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e91b93a8/0xcf1365f7cb055bf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.865157:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e91b93a8/0xcf1365f7cb055bf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.865165:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e91b93a8/0xcf1365f7cb055bf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.865172:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e91b93a8/0xcf1365f7cb055bf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.865193:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853720.865568:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853720.865575:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e91b93a8/0xcf1365f7cb055bf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.865595:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318f800 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:1.0:1787853720.865599:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e91b93a8/0xcf1365f7cb055bf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.865608:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e91b93a8/0xcf1365f7cb055bf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.865621:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e91b93a8/0xcf1365f7cb055bf1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.865646:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e91b93a8/0xcf1365f7cb055bf1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.865666:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853720.865668:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853720.865695:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.867119:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.867136:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001afa9c8a/0xcf1365f7cb055bf8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.867148:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.867152:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.867157:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001afa9c8a/0xcf1365f7cb055bf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.867168:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001afa9c8a/0xcf1365f7cb055bf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.867176:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001afa9c8a/0xcf1365f7cb055bf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.867183:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001afa9c8a/0xcf1365f7cb055bf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.867201:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787853720.867530:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787853720.867536:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001afa9c8a/0xcf1365f7cb055bf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.867544:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318ec00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:1.0:1787853720.867552:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001afa9c8a/0xcf1365f7cb055bf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.867561:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001afa9c8a/0xcf1365f7cb055bf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.867581:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001afa9c8a/0xcf1365f7cb055bf8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.867588:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001afa9c8a/0xcf1365f7cb055bf8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853720.867608:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853720.867610:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853720.867612:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.868219:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.868225:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bea25ad/0xcf1365f7cb055bff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.868234:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.868237:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.868241:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bea25ad/0xcf1365f7cb055bff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.868250:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bea25ad/0xcf1365f7cb055bff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.868265:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bea25ad/0xcf1365f7cb055bff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.868272:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bea25ad/0xcf1365f7cb055bff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.868286:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787853720.869082:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853720.869090:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bea25ad/0xcf1365f7cb055bff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.869099:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318f400 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:3.0:1787853720.869105:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bea25ad/0xcf1365f7cb055bff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.869113:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bea25ad/0xcf1365f7cb055bff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.869142:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bea25ad/0xcf1365f7cb055bff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.869149:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bea25ad/0xcf1365f7cb055bff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.869171:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853720.869185:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853720.869187:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787853720.870473:0:15879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787853720.870482:0:15879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040788d30/0xcf1365f7cb055c06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.870494:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1787853720.870498:0:15879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853720.870504:0:15879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040788d30/0xcf1365f7cb055c06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.870516:0:15879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040788d30/0xcf1365f7cb055c06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.870525:0:15879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040788d30/0xcf1365f7cb055c06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.870532:0:15879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040788d30/0xcf1365f7cb055c06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853720.870566:0:15879:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787853720.870869:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787853720.870876:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040788d30/0xcf1365f7cb055c06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.870887:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318e000 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:3.0:1787853720.870892:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040788d30/0xcf1365f7cb055c06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.870902:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040788d30/0xcf1365f7cb055c06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.870917:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040788d30/0xcf1365f7cb055c06 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.870925:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040788d30/0xcf1365f7cb055c06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853720.870957:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853720.870959:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853720.870962:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787853720.871017:0:15879:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1787853720.871110:0:15879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14438:x1874700152175232:12345-0@lo:5:osp-pre-1-0.0 Request processed in 129145us (141084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853720.871119:0:15879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787853720.871293:0:14438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14438:1874700152175232:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787853720.871307:0:14438:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787853720.871347:0:14438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748344000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14438:1874700152175488:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787853720.871382:0:14438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853720.871424:0:14438:0:(client.c:2715:ptlrpc_set_wait()) set ffff992775228000 going to sleep for 11 seconds 00000100:00100000:2.0:1787853720.871764:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152175488 00000100:00100000:2.0:1787853720.871770:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152175488 00000100:00100000:2.0:1787853720.871814:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787853720.871823:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748345e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14438:x1874700152175488:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787853720.871857:0:15094:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1787853720.881376:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748345e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14438:x1874700152175488:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9545us (9983us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787853720.881390:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787853720.881765:0:14438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748344000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14438:1874700152175488:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787853720.881781:0:14438:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1787853721.414557:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787853721.671303:0:14410:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787853721.671311:0:14410:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff992641d72000 from 8 10000000:01000000:3.0:1787853721.671316:0:14410:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787853721.671360:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992641daf400/0xcf1365f7cb055c0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853721.671372:0:14410:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992641daf400/0xcf1365f7cb055c0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853721.671382:0:14410:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992641daf400/0xcf1365f7cb055c0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853721.671406:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277522d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152175616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787853721.671470:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853721.671523:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff992741254540 going to sleep for 11 seconds 00000100:00100000:2.0:1787853721.671560:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152175616 00000100:00100000:2.0:1787853721.671568:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152175616 00000100:00100000:2.0:1787853721.671632:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787853721.671642:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+18:14410:x1874700152175616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853721.671655:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853721.671668:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99264318fc00/0xcf1365f7cb055c14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb055c0d expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853721.671711:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99264318fc00/0xcf1365f7cb055c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb055c0d expref: 19 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853721.671722:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99264318fc00/0xcf1365f7cb055c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb055c0d expref: 19 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853721.671746:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99264318fc00, rc 0) 00000100:00100000:2.0:1787853721.671797:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:14410:x1874700152175616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853721.671804:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787853721.671889:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277522d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152175616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853721.671904:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992641daf400/0xcf1365f7cb055c0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055c14 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853721.671911:0:14410:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992641daf400/0xcf1365f7cb055c0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb055c14 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853721.671961:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152175744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787853721.671994:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853721.672023:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff992744ef4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787853721.672061:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152175744 00000100:00100000:3.0:1787853721.672066:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152175744 00000100:00100000:3.0:1787853721.672097:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787853721.672103:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:14410:x1874700152175744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787853721.672117:0:14405:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787853721.672132:0:14405:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787853721.672139:0:14405:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1787853721.672220:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:14410:x1874700152175744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853721.672227:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787853721.675716:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152175744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787853721.675804:0:14410:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787853721.675816:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992641daf400/0xcf1365f7cb055c0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055c14 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853721.675837:0:14410:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992641daf400/0xcf1365f7cb055c0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055c14 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853722.437858:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787853722.499482:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1787853722.499563:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787853723.461885:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853724.492498:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787853725.080068:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1787853725.080133:0:7622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787853725.510844:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787853726.022584:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787853726.022620:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152175872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853726.022723:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853726.022830:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152175872 00000100:00100000:0.0:1787853726.022836:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152175872 00000100:00100000:0.0:1787853726.023014:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787853726.023024:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152175872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787853726.023055:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853726.023097:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152175872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853726.023104:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787853726.023128:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152176256:0@lo:400:kworker.0 00000100:00100000:0.0:1787853726.023154:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853726.023175:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787853726.023181:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152176128:0@lo:400:kworker.0 00000100:00100000:0.0:1787853726.023349:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787853726.023384:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853726.023395:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152176256 00000100:00100000:0.0:1787853726.023399:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152176256 00000100:00100000:0.0:1787853726.023428:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787853726.023435:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152176256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853726.023470:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152176256:12345-0@lo:400:kworker.0 Request processed in 35us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853726.023492:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787853726.023529:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99277c78f480 x1874700152176256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853726.023542:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152176256:0@lo:400:kworker.0 00000100:00100000:0.0:1787853726.023564:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3300:1874700152176000:0@lo:400:kworker.0 00000100:00100000:0.0:1787853726.023592:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853726.023752:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152176384:0@lo:400:kworker.0 00000100:00100000:3.0:1787853726.023782:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853726.023869:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152176128 00000100:00100000:3.0:1787853726.023875:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152176384 00000100:00100000:2.0:1787853726.023875:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152176128 00000100:00100000:3.0:1787853726.023882:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152176384 00000100:00100000:2.0:1787853726.023923:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853726.023926:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787853726.023936:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152176128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853726.023938:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152176384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853726.023992:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152176128:12345-0@lo:400:kworker.0 Request processed in 59us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853726.023999:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874700152176384:12345-0@lo:400:kworker.0 Request processed in 63us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853726.024003:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853726.024012:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787853726.024027:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787853726.024031:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787853726.024047:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992761e6bc00 x1874700152176384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787853726.024053:0:3298:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787853726.024063:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3299:1874700152176384:0@lo:400:kworker.0 00000100:00100000:2.0:1787853726.024071:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152176128:0@lo:400:kworker.0 00000100:00100000:0.0:1787853726.024491:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152176512:0@lo:400:kworker.0 00000100:00100000:0.0:1787853726.024520:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853726.024544:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787853726.024560:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152175872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853726.024582:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152176512 00000100:00100000:0.0:1787853726.024586:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152176512 00000100:00100000:0.0:1787853726.024633:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787853726.024639:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152176512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853726.024698:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152176512:12345-0@lo:400:kworker.0 Request processed in 59us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853726.024705:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787853726.024720:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787853726.024736:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff992761e6a580 x1874700152176512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787853742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787853726.024746:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152176512:0@lo:400:kworker.0 00000100:00100000:0.0:1787853726.024800:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787853726.024807:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992761e6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152176640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853726.024847:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853726.026331:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152176000 00000100:00100000:3.0:1787853726.026341:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152176000 00000100:00100000:3.0:1787853726.026386:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787853726.026396:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dcaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:3300:x1874700152176000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853726.026467:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dcaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:3300:x1874700152176000:12345-0@lo:400:kworker.0 Request processed in 73us (2873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853726.026475:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787853726.026543:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3300:1874700152176000:0@lo:400:kworker.0 00000100:00100000:0.0:1787853726.026818:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152176640 00000100:00100000:0.0:1787853726.026823:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152176640 00000100:00100000:0.0:1787853726.027385:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787853726.027397:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152176640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787853726.027426:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853726.027477:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e6a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152176640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (2630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853726.031348:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787853726.031641:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992761e6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152176640:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787853726.148099:0:16171:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg610-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787853726.533901:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853727.561397:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787853727.893224:0:14445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787853728.082082:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853728.082157:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136455680 00000100:00100000:0.0:1787853728.082166:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136455680 00000100:00100000:0.0:1787853728.082223:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 75 00000100:00100000:0.0:1787853728.082231:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dca8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2361:x1874700136455680:12345-192.168.206.10@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787853728.082260:0:14408:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from bbd02cf6-06c8-4693-a133-376b55bc6797@192.168.206.10@tcp t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:0.0:1787853728.082288:0:14408:0:(genops.c:1385:class_connect()) connect: client bbd02cf6-06c8-4693-a133-376b55bc6797, cookie 0xcf1365f7cb055c1b 00000100:00080000:0.0:1787853728.082426:0:14408:0:(import.c:65:import_set_state_nolock()) ffff99277653e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853728.082497:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dca8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbd02cf6-06c8-4693-a133-376b55bc6797+5:2361:x1874700136455680:12345-192.168.206.10@tcp:250:mount.lustre.0 Request processed in 266us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853728.082505:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 75 00000100:00100000:0.0:1787853728.084997:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853728.085088:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136455808 00000100:00100000:3.0:1787853728.085097:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136455808 00000100:00100000:3.0:1787853728.085151:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:3.0:1787853728.085160:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dcab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+5:13765:x1874700136455808:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787853728.085175:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853728.085192:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992641daf200/0xcf1365f7cb055c22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2334 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853728.085217:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992641daf200/0xcf1365f7cb055c22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2334 expref: 6 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853728.085229:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992641daf200/0xcf1365f7cb055c22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2334 expref: 6 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853728.085238:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992641daf200, rc 0) 00000100:00100000:3.0:1787853728.085304:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dcab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+6:13765:x1874700136455808:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 145us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853728.085311:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 76 00000100:00100000:2.0:1787853728.089257:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853728.089389:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136455936 00000100:00100000:3.0:1787853728.089398:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136455936 00000100:00100000:3.0:1787853728.089450:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:3.0:1787853728.089459:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dcab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+6:13765:x1874700136455936:12345-192.168.206.10@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787853728.089924:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dcab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+6:13765:x1874700136455936:12345-192.168.206.10@tcp:501:mount.lustre.0 Request processed in 464us (677us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787853728.089934:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 77 00000100:00100000:1.0:1787853728.091886:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853728.091980:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136456064 00000100:00100000:0.0:1787853728.091987:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136456064 00000100:00100000:0.0:1787853728.092073:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 78 00000100:00100000:0.0:1787853728.092082:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dcaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbd02cf6-06c8-4693-a133-376b55bc6797+6:13765:x1874700136456064:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787853728.092107:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853728.092122:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927587a8c00/0xcf1365f7cb055c29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd233b expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853728.092147:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927587a8c00/0xcf1365f7cb055c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd233b expref: 7 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853728.092158:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927587a8c00/0xcf1365f7cb055c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd233b expref: 7 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853728.092166:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a8c00, rc 0) 00000100:00100000:0.0:1787853728.092229:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dcaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbd02cf6-06c8-4693-a133-376b55bc6797+7:13765:x1874700136456064:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 147us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853728.092235:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 78 00000100:00100000:1.0:1787853728.094288:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853728.094385:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136456192 00000100:00100000:0.0:1787853728.094393:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136456192 00000100:00100000:0.0:1787853728.094570:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 79 00000100:00100000:0.0:1787853728.094580:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+7:13765:x1874700136456192:12345-192.168.206.10@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787853728.094888:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+8:13765:x1874700136456192:12345-192.168.206.10@tcp:501:mount.lustre.0 Request processed in 310us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853728.094896:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 79 00000100:00100000:2.0:1787853728.097647:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853728.097818:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136456320 00000100:00100000:0.0:1787853728.097895:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136456320 00000100:00100000:0.0:1787853728.097951:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 80 00000100:00100000:0.0:1787853728.097962:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbd02cf6-06c8-4693-a133-376b55bc6797+8:13765:x1874700136456320:12345-192.168.206.10@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787853728.098313:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbd02cf6-06c8-4693-a133-376b55bc6797+8:13765:x1874700136456320:12345-192.168.206.10@tcp:503:mount.lustre.0 Request processed in 351us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853728.098328:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 80 00000100:00100000:1.0:1787853728.112038:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853728.112970:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136456448 00000100:00100000:0.0:1787853728.112980:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136456448 00000100:00100000:2.0:1787853728.113218:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:2.0:1787853728.113228:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+8:13783:x1874700136456448:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787853728.113528:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+8:13783:x1874700136456448:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 300us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853728.113542:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 81 00000100:00100000:1.0:1787853728.126580:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853728.126969:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136456576 00000100:00100000:3.0:1787853728.126978:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136456576 00000100:00100000:3.0:1787853728.127034:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 82 00000100:00100000:3.0:1787853728.127044:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+8:13783:x1874700136456576:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787853728.127307:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+8:13783:x1874700136456576:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 264us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853728.127316:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 82 00000100:00100000:3.0:1787853728.134319:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853728.134402:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136456704 00000100:00100000:2.0:1787853728.134411:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136456704 00000100:00100000:2.0:1787853728.134597:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 83 00000100:00100000:2.0:1787853728.134609:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+8:13765:x1874700136456704:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787853728.134625:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853728.134643:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99264318e800/0xcf1365f7cb055c30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2365 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853728.134668:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99264318e800/0xcf1365f7cb055c30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2365 expref: 9 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853728.134714:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99264318e800/0xcf1365f7cb055c30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2365 expref: 9 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853728.134722:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99264318e800, rc 0) 00000100:00100000:2.0:1787853728.134774:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+9:13765:x1874700136456704:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 168us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853728.134783:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 83 00000100:00100000:1.0:1787853728.152793:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853728.152946:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136456832 00000100:00100000:3.0:1787853728.152959:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136456832 00000100:00100000:3.0:1787853728.153058:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 84 00000100:00100000:3.0:1787853728.153068:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+9:13765:x1874700136456832:12345-192.168.206.10@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787853728.153094:0:14407:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787853728.153117:0:14407:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787853728.153121:0:14407:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787853728.153124:0:14407:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787853728.153127:0:14407:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787853728.155048:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+9:13765:x1874700136456832:12345-192.168.206.10@tcp:256:mount.lustre.0 Request processed in 1973us (2255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853728.155070:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 84 00000100:00100000:2.0:1787853728.159408:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853728.159559:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136456960 00000100:00100000:3.0:1787853728.159568:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136456960 00000100:00100000:3.0:1787853728.159988:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00100000:3.0:1787853728.160001:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+9:13765:x1874700136456960:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787853728.160017:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853728.160034:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992641daee00/0xcf1365f7cb055c37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd236c expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853728.160078:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992641daee00/0xcf1365f7cb055c37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd236c expref: 10 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853728.160108:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992641daee00/0xcf1365f7cb055c37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd236c expref: 10 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853728.160118:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992641daee00, rc 0) 00000100:00100000:3.0:1787853728.160172:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+10:13765:x1874700136456960:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 174us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853728.160180:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 85 00000100:00100000:1.0:1787853728.162636:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853728.163116:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136457088 00000100:00100000:0.0:1787853728.163124:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136457088 00000100:00100000:0.0:1787853728.163275:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:0.0:1787853728.163286:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+10:13765:x1874700136457088:12345-192.168.206.10@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787853728.163563:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+10:13765:x1874700136457088:12345-192.168.206.10@tcp:501:mount.lustre.0 Request processed in 279us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853728.163572:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 86 00000100:00100000:0.0:1787853728.177801:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853728.178018:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136457216 00000100:00100000:3.0:1787853728.178027:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136457216 00000100:00100000:3.0:1787853728.178130:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 87 00000100:00100000:3.0:1787853728.178139:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+10:13765:x1874700136457216:12345-192.168.206.10@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787853728.178359:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+10:13765:x1874700136457216:12345-192.168.206.10@tcp:503:mount.lustre.0 Request processed in 220us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853728.178367:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 87 00000100:00100000:2.0:1787853728.183036:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853728.183171:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136457344 00000100:00100000:0.0:1787853728.183180:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136457344 00000100:00100000:0.0:1787853728.183233:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 88 00000100:00100000:0.0:1787853728.183243:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+10:13788:x1874700136457344:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787853728.183478:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+10:13788:x1874700136457344:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 236us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853728.183487:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 88 00000100:00100000:2.0:1787853728.187004:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853728.187563:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136457472 00000100:00100000:3.0:1787853728.187572:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136457472 00000100:00100000:3.0:1787853728.187642:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 89 00000100:00100000:3.0:1787853728.187651:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+10:13788:x1874700136457472:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787853728.188398:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+10:13788:x1874700136457472:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 744us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853728.188407:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 89 00000100:00100000:3.0:1787853728.197247:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853728.197618:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136457600 00000100:00100000:0.0:1787853728.197631:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136457600 00000100:00100000:0.0:1787853728.197734:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:0.0:1787853728.197745:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2361:x1874700136457600:12345-192.168.206.10@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787853728.198129:0:14414:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from d371ba61-36c8-41b1-a7d1-25796dee8fd1@192.168.206.10@tcp t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:3.0:1787853728.198203:0:14414:0:(genops.c:1385:class_connect()) connect: client d371ba61-36c8-41b1-a7d1-25796dee8fd1, cookie 0xcf1365f7cb055c3e 00000004:00100000:3.0:1787853728.198251:0:14414:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787853728.198260:0:14414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1787853728.274703:0:14414:0:(import.c:65:import_set_state_nolock()) ffff992641e01000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787853728.274878:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+6:2361:x1874700136457600:12345-192.168.206.10@tcp:38:mount.lustre.0 Request processed in 77131us (77644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853728.274892:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:3.0:1787853728.280942:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853728.281208:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136457856 00000100:00100000:0.0:1787853728.281220:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136457856 00000100:00100000:0.0:1787853728.281318:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:0.0:1787853728.281328:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+6:13765:x1874700136457856:12345-192.168.206.10@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787853728.281381:0:14413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787853728.281500:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+6:13765:x1874700136457856:12345-192.168.206.10@tcp:41:mount.lustre.0 Request processed in 173us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853728.281509:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00080000:1.0:1787853728.282631:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853728.285088:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853728.285198:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136457728 00000100:00100000:2.0:1787853728.285225:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136457728 00000100:00100000:2.0:1787853728.285299:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:2.0:1787853728.285311:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+6:0:x1874700136457728:12345-192.168.206.10@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787853728.285347:0:14414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787853728.285445:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+6:0:x1874700136457728:12345-192.168.206.10@tcp:41:mount.lustre.0 Request processed in 137us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853728.285453:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:0.0:1787853728.289471:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853728.289600:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136457984 00000100:00100000:3.0:1787853728.289613:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136457984 00000100:00100000:3.0:1787853728.289721:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:3.0:1787853728.289733:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+6:13765:x1874700136457984:12345-192.168.206.10@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787853728.289843:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+6:13765:x1874700136457984:12345-192.168.206.10@tcp:40:mount.lustre.0 Request processed in 112us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853728.289852:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:3.0:1787853728.292574:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853728.292716:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853728.293576:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136458496 00000100:00100000:1.0:1787853728.293626:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136458496 00000100:00100000:1.0:1787853728.293745:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 90 00000100:00100000:1.0:1787853728.293760:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbd02cf6-06c8-4693-a133-376b55bc6797+10:2364:x1874700136458496:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853728.293872:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbd02cf6-06c8-4693-a133-376b55bc6797+10:2364:x1874700136458496:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 116us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853728.293880:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 90 00000100:00100000:3.0:1787853728.295137:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136458368 00000100:00100000:3.0:1787853728.295151:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136458368 00000100:00100000:0.0:1787853728.297073:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853728.297137:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853728.297383:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136458112 00000100:00100000:1.0:1787853728.297396:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136458112 00000100:00100000:1.0:1787853728.297452:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136458240 00000100:00100000:1.0:1787853728.297456:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136458240 00000100:00100000:1.0:1787853728.297478:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:1.0:1787853728.297489:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1874700136458112:12345-192.168.206.10@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787853728.297531:0:15095:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from d371ba61-36c8-41b1-a7d1-25796dee8fd1@192.168.206.10@tcp t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:1.0:1787853728.297573:0:15095:0:(genops.c:1385:class_connect()) connect: client d371ba61-36c8-41b1-a7d1-25796dee8fd1, cookie 0xcf1365f7cb055c45 00002000:00100000:1.0:1787853728.297753:0:15095:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d371ba61-36c8-41b1-a7d1-25796dee8fd1/ffff99277c230000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113953 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787853728.297787:0:15095:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787853728.298394:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:0.0:1787853728.298411:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1874700136458240:12345-192.168.206.10@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787853728.298434:0:15096:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from d371ba61-36c8-41b1-a7d1-25796dee8fd1@192.168.206.10@tcp t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:0.0:1787853728.298464:0:15096:0:(genops.c:1385:class_connect()) connect: client d371ba61-36c8-41b1-a7d1-25796dee8fd1, cookie 0xcf1365f7cb055c4c 00002000:00100000:0.0:1787853728.298472:0:15096:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d371ba61-36c8-41b1-a7d1-25796dee8fd1/ffff992776538800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113953 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787853728.298489:0:15096:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787853728.298787:0:15096:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787853728.298831:0:15096:0:(import.c:65:import_set_state_nolock()) ffff99275f260800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853728.298938:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+6:2361:x1874700136458240:12345-192.168.206.10@tcp:8:mount.lustre.0 Request processed in 533us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853728.298947:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00002000:00080000:1.0:1787853728.299209:0:15095:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787853728.299315:0:15095:0:(import.c:65:import_set_state_nolock()) ffff99277c230800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787853728.299351:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+6:2361:x1874700136458112:12345-192.168.206.10@tcp:8:mount.lustre.0 Request processed in 1863us (2291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853728.299359:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:3.0:1787853728.299730:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:3.0:1787853728.299744:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+6:13765:x1874700136458368:12345-192.168.206.10@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787853728.305338:0:14416:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5490us 00000004:00200000:0.0:1787853728.344965:0:14416:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787853728.346662:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+6:13765:x1874700136458368:12345-192.168.206.10@tcp:33:mount.lustre.0 Request processed in 46907us (54085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853728.346719:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:0.0:1787853728.570956:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853728.577007:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136458624 00000100:00100000:3.0:1787853728.577028:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136458624 00000100:00100000:3.0:1787853728.577199:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:3.0:1787853728.577213:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+6:13808:x1874700136458624:12345-192.168.206.10@tcp:101:mkdir.0 00010000:00010000:3.0:1787853728.577241:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853728.577272:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafc00/0xcf1365f7cb055c53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2396 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853728.577381:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992641daec00/0xcf1365f7cb055c5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853728.577396:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992641daec00/0xcf1365f7cb055c5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853728.577414:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641daec00/0xcf1365f7cb055c5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853728.577865:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787853728.577871:0:14413:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853728.577983:0:14413:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992641daec00/0xcf1365f7cb055c5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853728.578018:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafc00/0xcf1365f7cb055c53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2396 expref: 8 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853728.578037:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992641daec00/0xcf1365f7cb055c5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2396 expref: 7 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853728.578046:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992742cdd800) 00010000:00010000:3.0:1787853728.578049:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787853728.578053:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992641daec00, rc 0) 00000100:00100000:3.0:1787853728.578200:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+7:13808:x1874700136458624:12345-192.168.206.10@tcp:101:mkdir.0 Request processed in 989us (7255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853728.578209:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00010000:00010000:2.0:1787853728.591916:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853729.606079:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787853730.161913:0:7622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d371ba61-36c8-41b1-a7d1-25796dee8fd1 00000100:00100000:2.0:1787853730.562711:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853730.562833:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136458752 00000100:00100000:3.0:1787853730.562921:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136458752 00000100:00100000:3.0:1787853730.563075:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:3.0:1787853730.563087:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+7:13862:x1874700136458752:12345-192.168.206.10@tcp:41:lfs.0 00000004:00000024:3.0:1787853730.563143:0:14414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787853730.563258:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+7:13862:x1874700136458752:12345-192.168.206.10@tcp:41:lfs.0 Request processed in 174us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853730.563267:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00080000:1.0:1787853730.564941:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853730.566862:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853730.566944:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136458880 00000100:00100000:1.0:1787853730.566957:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136458880 00000100:00100000:1.0:1787853730.567303:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:1.0:1787853730.567318:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d371ba61-36c8-41b1-a7d1-25796dee8fd1+6:13862:x1874700136458880:12345-192.168.206.10@tcp:13:lfs.0 00002000:00000024:1.0:1787853730.567386:0:15099:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787853730.567502:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787853730.568753:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d371ba61-36c8-41b1-a7d1-25796dee8fd1+6:13862:x1874700136458880:12345-192.168.206.10@tcp:13:lfs.0 Request processed in 1429us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853730.568777:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:0.0:1787853730.573427:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853730.573515:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136459008 00000100:00100000:2.0:1787853730.573527:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136459008 00000100:00100000:2.0:1787853730.573651:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:2.0:1787853730.573662:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992761e6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d371ba61-36c8-41b1-a7d1-25796dee8fd1+5:13862:x1874700136459008:12345-192.168.206.10@tcp:13:lfs.0 00002000:00000024:2.0:1787853730.573733:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787853730.573842:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992761e6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d371ba61-36c8-41b1-a7d1-25796dee8fd1+5:13862:x1874700136459008:12345-192.168.206.10@tcp:13:lfs.0 Request processed in 181us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853730.573851:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00080000:0.0:1787853730.576521:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787853730.629992:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853730.730219:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853730.730398:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136459136 00000100:00100000:3.0:1787853730.730411:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136459136 00000100:00100000:3.0:1787853730.730483:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 91 00000100:00100000:3.0:1787853730.730495:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+10:13895:x1874700136459136:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787853730.730516:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853730.730540:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992641dae800/0xcf1365f7cb055c61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd239d expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853730.730586:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992641dae800/0xcf1365f7cb055c61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd239d expref: 11 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853730.730600:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992641dae800/0xcf1365f7cb055c61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd239d expref: 11 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853730.730613:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992641dae800, rc 0) 00000100:00100000:3.0:1787853730.730709:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+11:13895:x1874700136459136:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 216us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853730.731010:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 91 00000100:00100000:3.0:1787853730.734399:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853730.736874:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136459264 00000100:00100000:0.0:1787853730.736961:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136459264 00000100:00100000:0.0:1787853730.737116:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 92 00000100:00100000:0.0:1787853730.737129:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+11:13895:x1874700136459264:12345-192.168.206.10@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787853730.737538:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+11:13895:x1874700136459264:12345-192.168.206.10@tcp:501:mount.lustre.0 Request processed in 410us (3150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853730.737547:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 92 00000100:00100000:0.0:1787853730.742876:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853730.744173:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136459392 00000100:00100000:1.0:1787853730.744188:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136459392 00000100:00100000:1.0:1787853730.744289:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 93 00000100:00100000:1.0:1787853730.744303:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dc0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbd02cf6-06c8-4693-a133-376b55bc6797+11:13895:x1874700136459392:12345-192.168.206.10@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787853730.744624:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dc0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbd02cf6-06c8-4693-a133-376b55bc6797+11:13895:x1874700136459392:12345-192.168.206.10@tcp:503:mount.lustre.0 Request processed in 324us (1760us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853730.744634:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 93 00000100:00100000:2.0:1787853730.752887:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853730.752986:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136459520 00000100:00100000:0.0:1787853730.752998:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136459520 00000100:00100000:0.0:1787853730.753068:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 94 00000100:00100000:0.0:1787853730.753080:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+11:13901:x1874700136459520:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787853730.753449:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c796450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+11:13901:x1874700136459520:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 370us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853730.753459:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 94 00000100:00100000:3.0:1787853730.765762:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853730.765907:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136459648 00000100:00100000:2.0:1787853730.765920:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136459648 00000100:00100000:2.0:1787853730.765984:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 95 00000100:00100000:2.0:1787853730.765997:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+11:13901:x1874700136459648:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787853730.766357:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+11:13901:x1874700136459648:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 361us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853730.766377:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 95 00000100:00100000:3.0:1787853730.770855:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853730.770964:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136459776 00000100:00100000:0.0:1787853730.770977:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136459776 00000100:00100000:0.0:1787853730.771095:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 96 00000100:00100000:0.0:1787853730.771107:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+11:13895:x1874700136459776:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787853730.771152:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853730.771184:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927587a9a00/0xcf1365f7cb055c68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd23c7 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853730.771222:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927587a9a00/0xcf1365f7cb055c68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23c7 expref: 12 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853730.771236:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927587a9a00/0xcf1365f7cb055c68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23c7 expref: 12 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853730.771248:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a9a00, rc 0) 00000100:00100000:0.0:1787853730.771331:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c796850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+12:13895:x1874700136459776:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 226us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853730.771340:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 96 00000100:00100000:3.0:1787853730.774056:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853730.774289:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136459904 00000100:00100000:1.0:1787853730.774301:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136459904 00000100:00100000:1.0:1787853730.774388:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 97 00000100:00100000:1.0:1787853730.774537:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbd02cf6-06c8-4693-a133-376b55bc6797+12:13895:x1874700136459904:12345-192.168.206.10@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787853730.774707:0:14408:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787853730.774741:0:14408:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787853730.774745:0:14408:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787853730.774749:0:14408:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787853730.774751:0:14408:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787853730.779970:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbd02cf6-06c8-4693-a133-376b55bc6797+12:13895:x1874700136459904:12345-192.168.206.10@tcp:256:mount.lustre.0 Request processed in 5557us (5911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853730.779989:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 97 00000100:00100000:3.0:1787853730.784051:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853730.784166:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136460032 00000100:00100000:0.0:1787853730.784178:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136460032 00000100:00100000:0.0:1787853730.784239:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 98 00000100:00100000:0.0:1787853730.784249:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+12:13895:x1874700136460032:12345-192.168.206.10@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787853730.784270:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853730.784291:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927587a9c00/0xcf1365f7cb055c6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd23ce expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853730.784325:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927587a9c00/0xcf1365f7cb055c6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23ce expref: 13 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853730.784337:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927587a9c00/0xcf1365f7cb055c6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23ce expref: 13 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853730.784370:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a9c00, rc 0) 00000100:00100000:0.0:1787853730.784503:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+13:13895:x1874700136460032:12345-192.168.206.10@tcp:101:mount.lustre.0 Request processed in 247us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853730.784512:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 98 00000100:00100000:3.0:1787853730.787842:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853730.788085:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136460160 00000100:00100000:1.0:1787853730.788096:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136460160 00000100:00100000:1.0:1787853730.788181:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 99 00000100:00100000:1.0:1787853730.788214:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbd02cf6-06c8-4693-a133-376b55bc6797+13:13895:x1874700136460160:12345-192.168.206.10@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787853730.788649:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbd02cf6-06c8-4693-a133-376b55bc6797+13:13895:x1874700136460160:12345-192.168.206.10@tcp:501:mount.lustre.0 Request processed in 438us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853730.788659:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 99 00000100:00100000:3.0:1787853730.795143:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853730.795447:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136460288 00000100:00100000:2.0:1787853730.795460:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136460288 00000100:00100000:2.0:1787853730.795590:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 100 00000100:00100000:2.0:1787853730.795602:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+13:13895:x1874700136460288:12345-192.168.206.10@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787853730.795919:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+13:13895:x1874700136460288:12345-192.168.206.10@tcp:503:mount.lustre.0 Request processed in 310us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853730.795928:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 100 00000100:00100000:3.0:1787853730.800502:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853730.800780:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136460416 00000100:00100000:1.0:1787853730.800793:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136460416 00000100:00100000:1.0:1787853730.800905:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 101 00000100:00100000:1.0:1787853730.800919:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbd02cf6-06c8-4693-a133-376b55bc6797+13:13905:x1874700136460416:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787853730.801247:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c794850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbd02cf6-06c8-4693-a133-376b55bc6797+13:13905:x1874700136460416:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 329us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853730.801257:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 101 00000100:00100000:3.0:1787853730.804892:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853730.805103:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136460544 00000100:00100000:2.0:1787853730.805117:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136460544 00000100:00100000:2.0:1787853730.805189:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 102 00000100:00100000:2.0:1787853730.805200:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992749175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+13:13905:x1874700136460544:12345-192.168.206.10@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787853730.806023:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992749175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+13:13905:x1874700136460544:12345-192.168.206.10@tcp:502:llog_process_th.0 Request processed in 819us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853730.806034:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 102 00000100:00100000:3.0:1787853730.809889:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853730.810134:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136460672 00000100:00100000:0.0:1787853730.810147:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136460672 00000100:00100000:0.0:1787853730.810242:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:0.0:1787853730.810254:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2361:x1874700136460672:12345-192.168.206.10@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787853730.810302:0:14413:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from 753260b7-c4c7-459e-9b8b-963f01a57f0c@192.168.206.10@tcp t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:0.0:1787853730.810530:0:14413:0:(genops.c:1385:class_connect()) connect: client 753260b7-c4c7-459e-9b8b-963f01a57f0c, cookie 0xcf1365f7cb055c76 00000004:00100000:0.0:1787853730.810570:0:14413:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787853730.810784:0:14413:0:(import.c:65:import_set_state_nolock()) ffff9927765f1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853730.810883:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+6:2361:x1874700136460672:12345-192.168.206.10@tcp:38:mount.lustre.0 Request processed in 628us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853730.810892:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:3.0:1787853730.816892:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853730.816998:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853730.817293:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136460928 00000100:00100000:0.0:1787853730.817305:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136460928 00000100:00080000:1.0:1787853730.817557:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853730.817897:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136460800 00000100:00100000:2.0:1787853730.817903:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136460800 00000100:00100000:3.0:1787853730.818102:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:3.0:1787853730.818116:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+7:13895:x1874700136460928:12345-192.168.206.10@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787853730.818175:0:14413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787853730.818326:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+7:13895:x1874700136460928:12345-192.168.206.10@tcp:41:mount.lustre.0 Request processed in 213us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853730.818334:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:3.0:1787853730.818359:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:3.0:1787853730.818367:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+6:0:x1874700136460800:12345-192.168.206.10@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787853730.818557:0:14413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787853730.818604:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+6:0:x1874700136460800:12345-192.168.206.10@tcp:41:mount.lustre.0 Request processed in 236us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853730.818611:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:2.0:1787853730.822516:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853730.822774:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136461056 00000100:00100000:3.0:1787853730.822786:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136461056 00000100:00100000:3.0:1787853730.822855:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:3.0:1787853730.822884:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9926421052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:753260b7-c4c7-459e-9b8b-963f01a57f0c+6:13895:x1874700136461056:12345-192.168.206.10@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787853730.822985:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9926421052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:753260b7-c4c7-459e-9b8b-963f01a57f0c+6:13895:x1874700136461056:12345-192.168.206.10@tcp:40:mount.lustre.0 Request processed in 104us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853730.822993:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:2.0:1787853730.825909:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853730.826020:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853730.826237:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136461440 00000100:00100000:3.0:1787853730.826249:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136461440 00000100:00100000:3.0:1787853730.826322:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:3.0:1787853730.826333:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:753260b7-c4c7-459e-9b8b-963f01a57f0c+6:13895:x1874700136461440:12345-192.168.206.10@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787853730.826724:0:14417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787853730.826882:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:753260b7-c4c7-459e-9b8b-963f01a57f0c+6:13895:x1874700136461440:12345-192.168.206.10@tcp:33:mount.lustre.0 Request processed in 550us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853730.826891:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:1.0:1787853730.829548:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136461184 00000100:00100000:1.0:1787853730.829567:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136461184 00000100:00100000:1.0:1787853730.829650:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:1.0:1787853730.829659:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642105680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1874700136461184:12345-192.168.206.10@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787853730.830089:0:15095:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 753260b7-c4c7-459e-9b8b-963f01a57f0c@192.168.206.10@tcp t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:1.0:1787853730.830137:0:15095:0:(genops.c:1385:class_connect()) connect: client 753260b7-c4c7-459e-9b8b-963f01a57f0c, cookie 0xcf1365f7cb055c7d 00002000:00100000:1.0:1787853730.830153:0:15095:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 753260b7-c4c7-459e-9b8b-963f01a57f0c/ffff992758f08800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113953 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787853730.830168:0:15095:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787853730.830563:0:15095:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1787853730.830808:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853730.830936:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136461312 00000100:00100000:0.0:1787853730.830953:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136461312 00000100:00100000:0.0:1787853730.831005:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:0.0:1787853730.831020:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277522c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2361:x1874700136461312:12345-192.168.206.10@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787853730.831050:0:15094:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 753260b7-c4c7-459e-9b8b-963f01a57f0c@192.168.206.10@tcp t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:0.0:1787853730.831090:0:15094:0:(genops.c:1385:class_connect()) connect: client 753260b7-c4c7-459e-9b8b-963f01a57f0c, cookie 0xcf1365f7cb055c84 00002000:00100000:0.0:1787853730.831098:0:15094:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 753260b7-c4c7-459e-9b8b-963f01a57f0c/ffff9927765f6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113953 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787853730.831134:0:15094:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787853730.831538:0:15094:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787853730.831765:0:15094:0:(import.c:65:import_set_state_nolock()) ffff9927765f2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787853730.832013:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277522c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+6:2361:x1874700136461312:12345-192.168.206.10@tcp:8:mount.lustre.0 Request processed in 996us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853730.832025:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00080000:1.0:1787853730.832116:0:15095:0:(import.c:65:import_set_state_nolock()) ffff992758f0b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787853730.832146:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642105680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:753260b7-c4c7-459e-9b8b-963f01a57f0c+6:2361:x1874700136461184:12345-192.168.206.10@tcp:8:mount.lustre.0 Request processed in 2488us (6126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853730.832164:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:2.0:1787853730.991556:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853730.992127:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136461568 00000100:00100000:3.0:1787853730.992142:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136461568 00000100:00100000:3.0:1787853730.992469:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:3.0:1787853730.992488:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642107c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+6:13926:x1874700136461568:12345-192.168.206.10@tcp:101:mkdir.0 00010000:00010000:3.0:1787853730.992517:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853730.992544:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641dae200/0xcf1365f7cb055c8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd23f8 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853730.993097:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055c92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853730.993122:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055c92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853730.993160:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055c92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853730.993713:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787853730.993719:0:14413:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853730.993956:0:14413:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055c92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853730.994061:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992641dae200/0xcf1365f7cb055c8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23f8 expref: 8 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853730.994082:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055c92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23f8 expref: 7 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853730.994091:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992742cdd800) 00010000:00010000:3.0:1787853730.994095:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787853730.994100:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992641dafa00, rc 0) 00000100:00100000:3.0:1787853730.994437:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642107c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+7:13926:x1874700136461568:12345-192.168.206.10@tcp:101:mkdir.0 Request processed in 1891us (2833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853730.994449:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:0.0:1787853731.142156:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152176768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853731.142270:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853731.142378:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152176768 00000100:00100000:0.0:1787853731.142388:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152176768 00000100:00100000:0.0:1787853731.142452:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787853731.142462:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152176768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787853731.142490:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853731.142541:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152176768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853731.142550:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787853731.142614:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152176768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787853731.142631:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dadcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3299:1874700152176896:0@lo:400:kworker.0 00000100:00100000:0.0:1787853731.142635:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dadde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1874700152177280:0@lo:400:kworker.0 00000100:00100000:0.0:1787853731.142662:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853731.142664:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853731.143638:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787853731.143653:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dade1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152177152:0@lo:400:kworker.0 00000100:00100000:0.0:1787853731.143729:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853731.143772:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152177280 00000100:00100000:0.0:1787853731.143778:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152177280 00000100:00100000:0.0:1787853731.143944:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152177152 00000100:00100000:0.0:1787853731.143948:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152177152 00000100:00100000:0.0:1787853731.143985:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787853731.143993:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874700152177280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853731.144046:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874700152177280:12345-0@lo:400:kworker.0 Request processed in 54us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853731.144114:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787853731.144135:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787853731.144142:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152177152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853731.144173:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152177152:12345-0@lo:400:kworker.0 Request processed in 32us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853731.144179:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787853731.144216:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dade1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152177152:0@lo:400:kworker.0 00000100:00100000:0.0:1787853731.144242:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dadde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3298:1874700152177280:0@lo:400:kworker.0 00000100:00100000:0.0:1787853731.144312:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dadd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152177024:0@lo:400:kworker.0 00000100:00100000:0.0:1787853731.144345:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853731.144396:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152177024 00000100:00100000:0.0:1787853731.144400:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152177024 00000100:00100000:0.0:1787853731.144431:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787853731.144437:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152177024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853731.144475:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152177024:12345-0@lo:400:kworker.0 Request processed in 37us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853731.144481:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787853731.144506:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dadd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152177024:0@lo:400:kworker.0 00000100:00080000:1.0:1787853731.144766:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787853731.144772:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787853731.144775:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787853731.144811:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152176896 00000100:00100000:1.0:1787853731.144816:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152176896 00000100:00100000:1.0:1787853731.144867:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787853731.144875:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992749175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:3299:x1874700152176896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853731.144915:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992749175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:3299:x1874700152176896:12345-0@lo:400:kworker.0 Request processed in 42us (2249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853731.144921:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787853731.146190:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748345a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152177536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853731.146271:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853731.146547:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152177536 00000100:00100000:2.0:1787853731.146555:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152177536 00000100:00100000:2.0:1787853731.146663:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787853731.146698:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152177536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787853731.146740:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787853731.146752:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dadcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3299:1874700152176896:0@lo:400:kworker.0 00000100:00100000:3.0:1787853731.146765:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dadf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152177408:0@lo:400:kworker.0 00000100:00100000:2.0:1787853731.146817:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152177536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853731.146826:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787853731.146924:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853731.146969:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748345a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152177536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853731.146989:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152177408 00000100:00100000:3.0:1787853731.147002:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152177408 00000100:00100000:3.0:1787853731.147150:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787853731.147157:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152177408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853731.147197:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874700152177408:12345-0@lo:400:kworker.0 Request processed in 41us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853731.147204:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787853731.147232:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dadf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3299:1874700152177408:0@lo:400:kworker.0 00000100:00080000:0.0:1787853731.147275:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787853731.655826:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853732.678554:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787853732.805479:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 753260b7-c4c7-459e-9b8b-963f01a57f0c 00000001:00100000:1.0:1787853732.805506:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d371ba61-36c8-41b1-a7d1-25796dee8fd1 00000001:02000400:3.0:1787853733.411408:0:16375:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787853733.701883:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787853733.757221:0:5846:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 753260b7-c4c7-459e-9b8b-963f01a57f0c 00000001:00100000:0.0:1787853733.757345:0:5846:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d371ba61-36c8-41b1-a7d1-25796dee8fd1 00010000:00010000:2.0:1787853734.734528:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787853735.348260:0:7622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 753260b7-c4c7-459e-9b8b-963f01a57f0c 00010000:00010000:3.0:1787853735.749875:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853735.868881:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853735.868927:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853735.868962:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853735.868983:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853735.869009:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136461952 00000100:00100000:1.0:1787853735.869018:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136461952 00000100:00100000:1.0:1787853735.869077:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136462464 00000100:00100000:1.0:1787853735.869080:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136462464 00000100:00100000:1.0:1787853735.869098:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:1.0:1787853735.869109:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+5:2365:x1874700136461952:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853735.869168:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748347480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+5:2365:x1874700136461952:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 61us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853735.869175:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:1.0:1787853735.869191:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:1.0:1787853735.869201:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748347840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+5:2365:x1874700136462464:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853735.869262:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748347840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+5:2365:x1874700136462464:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 63us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853735.869269:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00080000:1.0:1787853735.869285:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787853735.869289:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787853735.869579:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136461696 00000100:00100000:3.0:1787853735.869584:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136461696 00000100:00100000:3.0:1787853735.869621:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 104 00000100:00100000:3.0:1787853735.869629:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992749176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+13:2365:x1874700136461696:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:3.0:1787853735.869659:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992749176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+13:2365:x1874700136461696:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 31us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853735.869665:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 104 00000100:00100000:0.0:1787853735.869907:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136462208 00000100:00100000:0.0:1787853735.869912:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136462208 00000100:00100000:0.0:1787853735.869952:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:0.0:1787853735.869961:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:753260b7-c4c7-459e-9b8b-963f01a57f0c+6:2365:x1874700136462208:12345-192.168.206.10@tcp:400:kworker.0 00000100:00080000:1.0:1787853735.869965:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787853735.869993:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:753260b7-c4c7-459e-9b8b-963f01a57f0c+6:2365:x1874700136462208:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 34us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853735.869999:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:3.0:1787853735.870095:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853735.870160:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853735.870190:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853735.870280:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136461824 00000100:00100000:1.0:1787853735.870285:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136461824 00000100:00100000:1.0:1787853735.870345:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:1.0:1787853735.870355:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dade580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+6:2365:x1874700136461824:12345-192.168.206.10@tcp:400:kworker.0 00000100:00080000:3.0:1787853735.870394:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787853735.870730:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dade580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+6:2365:x1874700136461824:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 377us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853735.870737:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:1.0:1787853735.870756:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136462080 00000100:00100000:1.0:1787853735.870760:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136462080 00000100:00100000:1.0:1787853735.870803:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136462336 00000100:00100000:1.0:1787853735.870806:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136462336 00000100:00100000:1.0:1787853735.871052:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:1.0:1787853735.871060:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dade940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+5:2365:x1874700136462080:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853735.871094:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dade940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+5:2365:x1874700136462080:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 36us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853735.871101:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:1.0:1787853735.871111:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:1.0:1787853735.871118:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:753260b7-c4c7-459e-9b8b-963f01a57f0c+5:2365:x1874700136462336:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853735.871137:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:753260b7-c4c7-459e-9b8b-963f01a57f0c+5:2365:x1874700136462336:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 21us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853735.871156:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00080000:0.0:1787853735.871205:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787853735.871210:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787853736.261914:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787853736.261991:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787853736.262012:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748345680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152177792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787853736.262074:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853736.262182:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152177792 00000100:00100000:0.0:1787853736.262190:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152177792 00000100:00100000:0.0:1787853736.262244:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787853736.262253:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152177792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787853736.262286:0:15099:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853736.262331:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152177792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853736.262338:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787853736.262360:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853736.263138:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dadc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3299:1874700152177920:0@lo:400:kworker.0 00000100:00100000:0.0:1787853736.263197:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853736.263232:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787853736.263252:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dadfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152178048:0@lo:400:kworker.0 00000100:00100000:0.0:1787853736.263287:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853736.265062:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99264227ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152177664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853736.265128:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853736.265242:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787853736.265252:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dadc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152178176:0@lo:400:kworker.0 00000100:00100000:2.0:1787853736.265281:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853736.265293:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152177664 00000100:00100000:0.0:1787853736.265303:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152177664 00000100:00100000:0.0:1787853736.265359:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787853736.265368:0:15099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642106580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152177664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787853736.265402:0:15099:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853736.265450:0:15099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642106580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152177664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853736.265456:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787853736.265478:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853736.265735:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152177920 00000100:00100000:0.0:1787853736.265740:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152177920 00000100:00100000:2.0:1787853736.265755:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152178176 00000100:00100000:2.0:1787853736.265761:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152178176 00000100:00100000:0.0:1787853736.265776:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787853736.265786:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992742ca3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:3299:x1874700152177920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853736.265809:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787853736.265820:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992642105e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152178176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853736.265834:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992742ca3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:3299:x1874700152177920:12345-0@lo:400:kworker.0 Request processed in 49us (2635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853736.265841:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787853736.265868:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992642105e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874700152178176:12345-0@lo:400:kworker.0 Request processed in 49us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853736.265876:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787853736.265890:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dadc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3299:1874700152177920:0@lo:400:kworker.0 00000100:00100000:2.0:1787853736.266001:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dadc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874700152178176:0@lo:400:kworker.0 00000100:00100000:2.0:1787853736.266020:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99264227ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152177664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787853736.266781:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748345680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152177792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853736.267043:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152178048 00000100:00100000:1.0:1787853736.267049:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152178048 00000100:00100000:1.0:1787853736.267100:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787853736.267109:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152178048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853736.267185:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874700152178048:12345-0@lo:400:kworker.0 Request processed in 79us (3898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853736.267192:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787853736.267225:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dadfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3299:1874700152178048:0@lo:400:kworker.0 00000100:00100000:3.0:1787853736.267468:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787853736.267482:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dadf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152178432:0@lo:400:kworker.0 00000100:00100000:0.0:1787853736.267485:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787853736.267498:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dadcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152178304:0@lo:400:kworker.0 00000100:00100000:3.0:1787853736.267529:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853736.267570:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853736.267910:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152178432 00000100:00100000:1.0:1787853736.267916:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152178432 00000100:00100000:1.0:1787853736.267998:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152178304 00000100:00100000:1.0:1787853736.268002:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152178304 00000100:00100000:3.0:1787853736.268030:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787853736.268050:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276daded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152178432:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787853736.268071:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853736.268104:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276daded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874700152178432:12345-0@lo:400:kworker.0 Request processed in 56us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853736.268112:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787853736.268130:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dadf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3300:1874700152178432:0@lo:400:kworker.0 00000100:00100000:1.0:1787853736.268480:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787853736.268489:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152178304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853736.268536:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1874700152178304:12345-0@lo:400:kworker.0 Request processed in 49us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853736.268588:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dadcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3297:1874700152178304:0@lo:400:kworker.0 00000100:00100000:1.0:1787853736.268640:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000020:00000080:1.0:1787853736.602521:0:16526:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffedfba11a0 20000000:00000080:1.0:1787853736.602538:0:16526:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff992641dfcc00 uarg=0000000000000000 20000000:01000000:1.0:1787853736.602583:0:16526:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787853736.602588:0:16526:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787853736.602592:0:16526:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787853736.605956:0:16527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1787853736.606200:0:16526:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787853736.622426:0:16526:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787853736.622456:0:16526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99264318e600/0xcf1365f7cb055c99 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.622475:0:16526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff992766196400/0xcf1365f7cb055990 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb055989 expref: 18 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.622482:0:16526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9927587a9600/0xcf1365f7cb0559dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb0559d6 expref: 18 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.622489:0:16526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9927821c6200/0xcf1365f7cb055a4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb055a46 expref: 18 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.622499:0:16526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff992641daee00/0xcf1365f7cb055c37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd236c expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.622506:0:16526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9927587a9c00/0xcf1365f7cb055c6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23ce expref: 12 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.622514:0:16526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99264318e600/0xcf1365f7cb055c99 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.622628:0:16526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9927587a9c00/0xcf1365f7cb055c6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23ce expref: 12 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.622644:0:16526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9927587a9c00/0xcf1365f7cb055c6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23ce expref: 12 pid: 14407 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853736.622659:0:16526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9926421061c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16526:1874700152178560:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787853736.622965:0:16526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff992641daee00/0xcf1365f7cb055c37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd236c expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.622974:0:16526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff992641daee00/0xcf1365f7cb055c37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd236c expref: 12 pid: 14405 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853736.622983:0:16526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992760d7cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16526:1874700152178688:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787853736.623027:0:16526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9927821c6200/0xcf1365f7cb055a4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb055a46 expref: 18 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.623035:0:16526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9927821c6200/0xcf1365f7cb055a4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb055a46 expref: 18 pid: 14405 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853736.623044:0:16526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992760d7d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16526:1874700152178816:0@lo:104: 00000100:00100000:2.0:1787853736.623081:0:16526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787853736.623115:0:16526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9927587a9600/0xcf1365f7cb0559dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb0559d6 expref: 18 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.623123:0:16526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9927587a9600/0xcf1365f7cb0559dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb0559d6 expref: 18 pid: 14408 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853736.623130:0:16526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748386580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16526:1874700152178944:0@lo:104: 00000100:00100000:2.0:1787853736.623151:0:16526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853736.623193:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152178816 00000100:00100000:2.0:1787853736.623200:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152178816 00000100:00100000:2.0:1787853736.623248:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152178944 00000100:00100000:2.0:1787853736.623252:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152178944 00000100:00100000:2.0:1787853736.623267:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787853736.623275:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483843c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+4:16526:x1874700152178816:12345-0@lo:104: 00010000:00010000:2.0:1787853736.623295:0:14397:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9927587a8200/0xcf1365f7cb055a46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb055a4d expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.623340:0:14397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787853736.623346:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483843c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+4:16526:x1874700152178816:12345-0@lo:104: Request processed in 72us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853736.623352:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787853736.623370:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787853736.623376:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+3:16526:x1874700152178944:12345-0@lo:104: 00010000:00010000:2.0:1787853736.623383:0:14397:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb0559d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0559dd expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.623415:0:14397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787853736.623420:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+3:16526:x1874700152178944:12345-0@lo:104: Request processed in 46us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853736.623426:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787853736.623442:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787853736.623448:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9927587a8200/0xcf1365f7cb055a46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb055a4d expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.623455:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a8200 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1787853736.623459:0:14402:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9927587a8200/0xcf1365f7cb055a46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb055a4d expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.623467:0:14402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9927587a8200/0xcf1365f7cb055a46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb055a4d expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853736.623474:0:14402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9927587a8200/0xcf1365f7cb055a46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb055a4d expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853736.623486:0:14402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787853736.623512:0:14402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9927587a8200/0xcf1365f7cb055a46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb055a4d expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.623519:0:14402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853736.623538:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9927587a8200/0xcf1365f7cb055a46 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb055a4d expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.623561:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9927587a8200/0xcf1365f7cb055a46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb055a4d expref: -99 pid: 15811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.623573:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853736.623576:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb0559d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb0559dd expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.623582:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992747f71400 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1787853736.623585:0:14402:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb0559d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb0559dd expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.623591:0:14402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb0559d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb0559dd expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853736.623597:0:14402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb0559d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb0559dd expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853736.623603:0:14402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787853736.623615:0:14402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb0559d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0559dd expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.623620:0:14402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853736.623641:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb0559d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0559dd expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.623647:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff992747f71400/0xcf1365f7cb0559d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb0559dd expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.623656:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853736.623658:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853736.623660:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853736.623706:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748384b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3300:1874700152179072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853736.623737:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787853736.623777:0:16526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff992766196400/0xcf1365f7cb055990 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf1365f7cb055989 expref: 18 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.623786:0:16526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff992766196400/0xcf1365f7cb055990 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf1365f7cb055989 expref: 18 pid: 14405 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853736.623794:0:16526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748387480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16526:1874700152179328:0@lo:104: 00000100:00100000:2.0:1787853736.623820:0:16526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853736.623846:0:14397:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787853736.623855:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152179328 00000100:00100000:2.0:1787853736.623859:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152179328 00000100:00100000:2.0:1787853736.623878:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787853736.623883:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c1f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+3:16526:x1874700152179328:12345-0@lo:104: 00010000:00010000:2.0:1787853736.623891:0:14397:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb055989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb055990 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.623922:0:14397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787853736.623927:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c1f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+3:16526:x1874700152179328:12345-0@lo:104: Request processed in 44us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853736.623939:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787853736.623981:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853736.623985:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb055989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf1365f7cb055990 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.623993:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a9400 already unused, calling callback (ffffffffc1adac20) 10000000:00010000:2.0:1787853736.623996:0:14402:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb055989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf1365f7cb055990 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.624003:0:14402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb055989 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf1365f7cb055990 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787853736.624010:0:14402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb055989 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf1365f7cb055990 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853736.624016:0:14402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787853736.624030:0:14402:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb055989 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb055990 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.624036:0:14402:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787853736.624042:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb055989 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb055990 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.624049:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.110@tcp lock: ffff9927587a9400/0xcf1365f7cb055989 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf1365f7cb055990 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.624060:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853736.624062:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853736.624063:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853736.624074:0:16526:0:(client.c:2715:ptlrpc_set_wait()) set ffff992775228000 going to sleep for 11 seconds 00000100:00100000:2.0:1787853736.624100:0:16526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992760d7d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16526:1874700152178816:0@lo:104: 00000100:00100000:2.0:1787853736.624108:0:16526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748386580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16526:1874700152178944:0@lo:104: 00000100:00100000:2.0:1787853736.624113:0:16526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748387480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16526:1874700152179328:0@lo:104: 00000100:00100000:1.0:1787853736.624456:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927483843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3298:1874700152179456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787853736.624485:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853736.624526:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787853736.624533:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748384f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3298:1874700152179200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787853736.624568:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853736.624593:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152179072 00000100:00100000:1.0:1787853736.624597:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152179072 00010000:00010000:1.0:1787853736.624627:0:14399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9927821c6200/0xcf1365f7cb055a4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb055a46 expref: 19 pid: 14405 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853736.624640:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152179456 00000100:00100000:1.0:1787853736.624643:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152179456 00010000:00010000:1.0:1787853736.624652:0:14399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff992766196400/0xcf1365f7cb055990 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb055989 expref: 20 pid: 14405 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853736.624660:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152179200 00000100:00100000:1.0:1787853736.624662:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152179200 00010000:00010000:1.0:1787853736.624690:0:14399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9927587a9600/0xcf1365f7cb0559dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0559d6 expref: 21 pid: 14408 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853736.624704:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787853736.624712:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748387c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+21:3300:x1874700152179072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787853736.624721:0:14399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853736.624725:0:14399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9927821c6200/0xcf1365f7cb055a4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb055a46 expref: 21 pid: 14405 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.624734:0:14399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9927821c6200/0xcf1365f7cb055a4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb055a46 expref: 21 pid: 14405 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.624746:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927821c6200/0xcf1365f7cb055a4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb055a46 expref: 21 pid: 14405 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.624758:0:14399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853736.624793:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748387c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+20:3300:x1874700152179072:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853736.624799:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787853736.624819:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787853736.624828:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748345a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:3298:x1874700152179456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787853736.624834:0:14399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853736.624838:0:14399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff992766196400/0xcf1365f7cb055990 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb055989 expref: 19 pid: 14405 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.624846:0:14399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff992766196400/0xcf1365f7cb055990 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb055989 expref: 19 pid: 14405 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853736.625116:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853736.625320:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992766196400/0xcf1365f7cb055990 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb055989 expref: 19 pid: 14405 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.625331:0:14399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853736.625362:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748345a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+18:3298:x1874700152179456:12345-0@lo:103:ldlm_bl.0 Request processed in 538us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853736.625369:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787853736.625382:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787853736.625391:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9926435a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+17:3298:x1874700152179200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787853736.625398:0:14399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853736.625403:0:14399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9927587a9600/0xcf1365f7cb0559dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf1365f7cb0559d6 expref: 17 pid: 14408 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.625411:0:14399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9927587a9600/0xcf1365f7cb0559dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf1365f7cb0559d6 expref: 17 pid: 14408 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.625419:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927587a9600/0xcf1365f7cb0559dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf1365f7cb0559d6 expref: 17 pid: 14408 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.625434:0:14399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853736.625457:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9926435a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:3298:x1874700152179200:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853736.625464:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787853736.625517:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748384b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3300:1874700152179072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787853736.625559:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748384f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3298:1874700152179200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787853736.625568:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927483843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3298:1874700152179456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787853736.628998:0:16526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9926421061c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16526:1874700152178560:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787853736.629335:0:16526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992760d7cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16526:1874700152178688:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787853736.629369:0:16526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99264318e600/0xcf1365f7cb055c99 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853736.631848:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853736.632994:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853736.634600:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136462592 00000100:00100000:1.0:1787853736.634728:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136462592 00010000:00010000:1.0:1787853736.634782:0:14399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9927587a9c00/0xcf1365f7cb055c6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23ce expref: 13 pid: 14407 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853736.634809:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136462720 00000100:00100000:1.0:1787853736.634813:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136462720 00010000:00010000:1.0:1787853736.634826:0:14399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff992641daee00/0xcf1365f7cb055c37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd236c expref: 14 pid: 14405 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853736.634840:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:1.0:1787853736.634850:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748387480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbd02cf6-06c8-4693-a133-376b55bc6797+14:2364:x1874700136462592:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853736.634864:0:14399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853736.634869:0:14399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9927587a9c00/0xcf1365f7cb055c6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23ce expref: 14 pid: 14407 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.634881:0:14399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9927587a9c00/0xcf1365f7cb055c6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23ce expref: 14 pid: 14407 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.634918:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9927587a9c00/0xcf1365f7cb055c6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23ce expref: 14 pid: 14407 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.634931:0:14399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853736.634993:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748387480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbd02cf6-06c8-4693-a133-376b55bc6797+13:2364:x1874700136462592:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 144us (3152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853736.634996:0:14398:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787853736.635000:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:0.0:1787853736.635004:0:14398:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787853736.635017:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:1.0:1787853736.635026:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbd02cf6-06c8-4693-a133-376b55bc6797+12:2364:x1874700136462720:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853736.635034:0:14399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853736.635039:0:14399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff992641daee00/0xcf1365f7cb055c37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd236c expref: 12 pid: 14405 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.635100:0:14399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff992641daee00/0xcf1365f7cb055c37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd236c expref: 12 pid: 14405 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.635114:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff992641daee00/0xcf1365f7cb055c37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd236c expref: 12 pid: 14405 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.635125:0:14399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99264318e600/0xcf1365f7cb055c99 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.635133:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99264318e600/0xcf1365f7cb055c99 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.635146:0:14399:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99264318e600/0xcf1365f7cb055c99 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.635161:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99264318e600/0xcf1365f7cb055c99 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.635168:0:14399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99264318e600/0xcf1365f7cb055c99 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.635174:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99264318e600/0xcf1365f7cb055c99 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.635180:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318e600 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:1.0:1787853736.635184:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99264318e600/0xcf1365f7cb055c99 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.635192:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99264318e600/0xcf1365f7cb055c99 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.635207:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99264318e600/0xcf1365f7cb055c99 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853736.635220:0:14399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853736.635241:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbd02cf6-06c8-4693-a133-376b55bc6797+11:2364:x1874700136462720:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 217us (2254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853736.635249:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00010000:00010000:2.0:1787853736.635448:0:16526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99264318e600/0xcf1365f7cb055c99 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.635457:0:16526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99264318e600/0xcf1365f7cb055c99 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.635463:0:16526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99264318e600/0xcf1365f7cb055c99 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853736.779460:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787853737.094418:0:14445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787853737.803007:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853738.559983:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853738.560070:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136462848 00000100:00100000:3.0:1787853738.560078:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136462848 00000100:00100000:3.0:1787853738.560128:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 106 00000100:00100000:3.0:1787853738.560137:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992742ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbd02cf6-06c8-4693-a133-376b55bc6797+11:13779:x1874700136462848:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853738.560153:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853738.560169:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992641dafe00/0xcf1365f7cb055ca0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd23ff expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853738.560195:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992641dafe00/0xcf1365f7cb055ca0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23ff expref: 12 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853738.560205:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992641dafe00/0xcf1365f7cb055ca0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23ff expref: 12 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853738.560215:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992641dafe00, rc 0) 00000100:00100000:3.0:1787853738.560273:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992742ca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbd02cf6-06c8-4693-a133-376b55bc6797+12:13779:x1874700136462848:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 136us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853738.560280:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 106 00000100:00100000:3.0:1787853738.566716:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853738.566753:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136462976 00000100:00100000:3.0:1787853738.566761:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136462976 00000100:00100000:3.0:1787853738.566824:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 107 00000100:00100000:3.0:1787853738.566832:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992742ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+12:13779:x1874700136462976:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853738.567140:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992742ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+12:13779:x1874700136462976:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 307us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853738.567149:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 107 00000100:00100000:0.0:1787853738.581138:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853738.581361:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136463104 00000100:00100000:2.0:1787853738.581370:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136463104 00000100:00100000:2.0:1787853738.581608:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 108 00000100:00100000:2.0:1787853738.581618:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992742ca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+12:13779:x1874700136463104:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853738.585074:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992742ca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+12:13779:x1874700136463104:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 Request processed in 3446us (3933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853738.585088:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 108 00000100:00100000:0.0:1787853738.602763:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853738.603576:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136463232 00000100:00100000:3.0:1787853738.603585:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136463232 00000100:00100000:3.0:1787853738.603640:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 109 00000100:00100000:3.0:1787853738.603650:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992760812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+12:13779:x1874700136463232:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853738.603666:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853738.603701:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992641dafc00/0xcf1365f7cb055ca7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2406 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853738.603728:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992641dafc00/0xcf1365f7cb055ca7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2406 expref: 13 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853738.603739:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992641dafc00/0xcf1365f7cb055ca7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2406 expref: 13 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853738.603747:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992641dafc00, rc 0) 00000100:00100000:3.0:1787853738.603805:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992760812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+13:13779:x1874700136463232:12345-192.168.206.10@tcp:101:ll_cfg_requeue.0 Request processed in 157us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853738.603812:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 109 00000100:00100000:3.0:1787853738.615185:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853738.616591:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136463360 00000100:00100000:2.0:1787853738.616602:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136463360 00000100:00100000:3.0:1787853738.617960:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 110 00000100:00100000:3.0:1787853738.617971:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+13:13779:x1874700136463360:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853738.618224:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bbd02cf6-06c8-4693-a133-376b55bc6797+13:13779:x1874700136463360:12345-192.168.206.10@tcp:501:ll_cfg_requeue.0 Request processed in 253us (3046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853738.618232:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 110 00000100:00100000:0.0:1787853738.626695:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853738.626892:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136463488 00000100:00100000:3.0:1787853738.626902:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136463488 00000100:00100000:3.0:1787853738.626943:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 111 00000100:00100000:3.0:1787853738.626951:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+13:13779:x1874700136463488:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853738.627148:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bbd02cf6-06c8-4693-a133-376b55bc6797+13:13779:x1874700136463488:12345-192.168.206.10@tcp:503:ll_cfg_requeue.0 Request processed in 196us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853738.627157:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 111 10000000:01000000:3.0:1787853738.636266:0:14410:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787853738.636273:0:14410:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9927441ba000 from 10 10000000:01000000:3.0:1787853738.636278:0:14410:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787853738.636322:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992641dae600/0xcf1365f7cb055cae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853738.636335:0:14410:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992641dae600/0xcf1365f7cb055cae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853738.636359:0:14410:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992641dae600/0xcf1365f7cb055cae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853738.636394:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dadf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152179584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787853738.636646:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853738.636725:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff99275169bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853738.638649:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152179584 00000100:00100000:2.0:1787853738.638660:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152179584 00000100:00100000:2.0:1787853738.638723:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787853738.638732:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+16:14410:x1874700152179584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853738.638754:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853738.638770:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99264318f400/0xcf1365f7cb055cb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb055cae expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853738.638792:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99264318f400/0xcf1365f7cb055cb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb055cae expref: 17 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853738.638803:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99264318f400/0xcf1365f7cb055cb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb055cae expref: 17 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853738.638811:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99264318f400, rc 0) 00000100:00100000:2.0:1787853738.638880:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+17:14410:x1874700152179584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (2235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853738.638886:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787853738.638937:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dadf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152179584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853738.638954:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992641dae600/0xcf1365f7cb055cae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055cb5 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853738.638963:0:14410:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992641dae600/0xcf1365f7cb055cae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb055cb5 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853738.639026:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927483852c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152179712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853738.639056:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853738.639076:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff992775228900 going to sleep for 11 seconds 00000100:00100000:2.0:1787853738.639087:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152179712 00000100:00100000:2.0:1787853738.639091:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152179712 00000100:00100000:2.0:1787853738.639107:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787853738.639113:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c27ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+17:14410:x1874700152179712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853738.639339:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c27ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+17:14410:x1874700152179712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 224us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853738.640553:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787853738.640615:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927483852c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152179712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853738.640653:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927483852c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152179840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853738.640714:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853738.640736:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff992775228900 going to sleep for 11 seconds 00000100:00100000:2.0:1787853738.640751:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152179840 00000100:00100000:2.0:1787853738.640755:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152179840 00000100:00100000:2.0:1787853738.640777:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787853738.640783:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+17:14410:x1874700152179840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787853738.640935:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+17:14410:x1874700152179840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853738.640942:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787853738.640977:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927483852c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152179840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787853738.643914:0:16634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787853738.650036:0:14410:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787853738.650069:0:14410:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787853738.650081:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992641dae600/0xcf1365f7cb055cae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055cb5 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853738.650094:0:14410:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992641dae600/0xcf1365f7cb055cae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055cb5 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787853738.650104:0:14410:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787853738.650107:0:14410:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff992758c39000 from 10 10000000:01000000:3.0:1787853738.650109:0:14410:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787853738.650146:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff992641daf600/0xcf1365f7cb055cbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853738.650154:0:14410:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff992641daf600/0xcf1365f7cb055cbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853738.650164:0:14410:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff992641daf600/0xcf1365f7cb055cbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853738.650187:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dadfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152179968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787853738.650250:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853738.650295:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff99275169bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853738.651745:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152179968 00000100:00100000:0.0:1787853738.651755:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152179968 00000100:00100000:0.0:1787853738.651800:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787853738.651809:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c27b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+17:14410:x1874700152179968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787853738.651823:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787853738.651837:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9927587a8600/0xcf1365f7cb055cc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb055cbc expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853738.651860:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9927587a8600/0xcf1365f7cb055cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb055cbc expref: 18 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853738.651871:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9927587a8600/0xcf1365f7cb055cc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb055cbc expref: 18 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853738.651879:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9927587a8600, rc 0) 00000100:00100000:0.0:1787853738.651936:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c27b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:606eab1b-a99f-4bb0-a1c7-11b5915f771c+18:14410:x1874700152179968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853738.651943:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787853738.652043:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dadfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152179968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853738.652058:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff992641daf600/0xcf1365f7cb055cbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055cc3 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853738.652067:0:14410:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff992641daf600/0xcf1365f7cb055cbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb055cc3 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853738.652135:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dadfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152180096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853738.652166:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853738.652193:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff99275169bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853738.652208:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152180096 00000100:00100000:3.0:1787853738.652212:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152180096 00000100:00100000:3.0:1787853738.652231:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787853738.652236:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c27b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+18:14410:x1874700152180096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853738.652570:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c27b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+18:14410:x1874700152180096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 332us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853738.652577:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787853738.652608:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dadfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152180096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787853738.652634:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276dadfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152180224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853738.652692:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853738.652707:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff99275169bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853738.652719:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152180224 00000100:00100000:3.0:1787853738.652723:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152180224 00000100:00100000:3.0:1787853738.652739:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787853738.652744:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c27a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+18:14410:x1874700152180224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787853738.652881:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c27a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+18:14410:x1874700152180224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853738.652888:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787853738.652926:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276dadfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152180224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787853738.654893:0:16635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787853738.655049:0:14410:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787853738.655069:0:14410:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787853738.655079:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff992641daf600/0xcf1365f7cb055cbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055cc3 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853738.655089:0:14410:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff992641daf600/0xcf1365f7cb055cbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055cc3 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787853738.655099:0:14410:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787853738.655107:0:14410:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff992641d72000 from 10 10000000:01000000:2.0:1787853738.655110:0:14410:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787853738.655138:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.110@tcp lock: ffff99264318f800/0xcf1365f7cb055cca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853738.655146:0:14410:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.110@tcp lock: ffff99264318f800/0xcf1365f7cb055cca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853738.655155:0:14410:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.110@tcp lock: ffff99264318f800/0xcf1365f7cb055cca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853738.655176:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927483852c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152180352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787853738.655228:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853738.655266:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff992775228900 going to sleep for 11 seconds 00000100:00100000:3.0:1787853738.655315:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152180352 00000100:00100000:3.0:1787853738.655321:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152180352 00000100:00100000:3.0:1787853738.655595:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787853738.655605:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c27a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+18:14410:x1874700152180352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787853738.655616:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853738.655628:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff992641dae000/0xcf1365f7cb055cd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf1365f7cb055cca expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853738.655648:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff992641dae000/0xcf1365f7cb055cd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf1365f7cb055cca expref: 19 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853738.655658:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff992641dae000/0xcf1365f7cb055cd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf1365f7cb055cca expref: 19 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853738.655666:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992641dae000, rc 0) 00000100:00100000:3.0:1787853738.655725:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c27a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:14410:x1874700152180352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853738.655732:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787853738.659827:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927483852c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152180352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787853738.659855:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.110@tcp lock: ffff99264318f800/0xcf1365f7cb055cca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055cd1 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853738.659868:0:14410:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.110@tcp lock: ffff99264318f800/0xcf1365f7cb055cca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf1365f7cb055cd1 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853738.659946:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927483852c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152180480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787853738.660004:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853738.660049:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff992775228900 going to sleep for 11 seconds 00000100:00100000:1.0:1787853738.660097:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152180480 00000100:00100000:1.0:1787853738.660105:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152180480 00000100:00100000:1.0:1787853738.660164:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787853738.660175:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c27b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:14410:x1874700152180480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853738.660444:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c27b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:14410:x1874700152180480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853738.660451:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787853738.660485:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927483852c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152180480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787853738.660512:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748346940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152180608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853738.660561:0:14410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853738.660575:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff992741254cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787853738.660586:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152180608 00000100:00100000:1.0:1787853738.660589:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152180608 00000100:00100000:1.0:1787853738.660609:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787853738.660615:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c27bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:14410:x1874700152180608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787853738.660779:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c27bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:14410:x1874700152180608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853738.660786:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787853738.660823:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748346940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:606eab1b-a99f-4bb0-a1c7-11b5915f771c:14410:1874700152180608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787853738.671367:0:16637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787853738.671701:0:14410:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787853738.671721:0:14410:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.110@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787853738.671733:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.110@tcp lock: ffff99264318f800/0xcf1365f7cb055cca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055cd1 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853738.671744:0:14410:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.110@tcp lock: ffff99264318f800/0xcf1365f7cb055cca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf1365f7cb055cd1 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853738.822553:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787853739.849363:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853740.187940:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853740.188049:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136463616 00000100:00100000:1.0:1787853740.188057:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136463616 00000100:00100000:1.0:1787853740.188122:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:1.0:1787853740.188146:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+6:14436:x1874700136463616:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853740.188166:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853740.188186:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196a00/0xcf1365f7cb055cd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd240d expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.188245:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055cdf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.188272:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055cdf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.188285:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055cdf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.188300:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055ce6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.188307:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.188313:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.188975:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb055ced lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.188987:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb055ced lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.188995:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb055ced lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853740.189080:0:14415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787853740.189085:0:14415:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853740.189180:0:14415:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb055ced lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.189192:0:14415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055cdf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.189207:0:14415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055cdf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.189213:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055cdf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.189219:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197a00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853740.189223:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055cdf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.189230:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055cdf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.189241:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992742cdd800) 00010000:00010000:1.0:1787853740.189243:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853740.189247:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055cdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.189252:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055cdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.189263:0:14415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.189268:0:14415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055ce6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.189274:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055ce6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.189278:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853740.189287:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055ce6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.189293:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055ce6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.189301:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9927433f1c00) 00010000:00010000:1.0:1787853740.189304:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853740.189306:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055ce6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.189312:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055ce6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.190103:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196a00/0xcf1365f7cb055cd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd240d expref: 8 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.190122:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196800/0xcf1365f7cb055ced lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd240d expref: 7 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.190130:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9927433f1500) 00010000:00010000:1.0:1787853740.190132:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787853740.190134:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196800, rc 0) 00000100:00100000:1.0:1787853740.190193:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+7:14436:x1874700136463616:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 2062us (2261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853740.190201:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00080000:0.0:1787853740.190535:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787853740.193620:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853740.193736:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136463872 00000100:00100000:1.0:1787853740.193745:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136463872 00000100:00100000:1.0:1787853740.193809:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:1.0:1787853740.193819:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+7:14436:x1874700136463872:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853740.193851:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853740.193870:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb055cf4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2414 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.193941:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055cfb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.193954:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055cfb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.193964:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055cfb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.193977:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055d02 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.193984:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055d02 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.193990:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055d02 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.194650:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055d09 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.194661:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055d09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.194669:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055d09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853740.194706:0:14414:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787853740.194971:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055cfb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.194979:0:14414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055cfb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.194986:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055cfb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.194992:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853740.194996:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055cfb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.195003:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055cfb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.195016:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9927433f1500) 00010000:00010000:1.0:1787853740.195019:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853740.195023:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055cfb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.195030:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055cfb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.195041:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055d02 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.195047:0:14414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055d02 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.195052:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055d02 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.195067:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853740.195070:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055d02 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.195076:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055d02 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.195084:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9927433f1100) 00010000:00010000:1.0:1787853740.195086:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853740.195089:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055d02 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.195095:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055d02 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.198746:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb055cf4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2414 expref: 10 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.198771:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196000/0xcf1365f7cb055d09 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2414 expref: 9 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.198779:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9927433f1700) 00010000:00010000:1.0:1787853740.198782:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853740.198785:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196000, rc 0) 00000100:00100000:1.0:1787853740.198923:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+9:14436:x1874700136463872:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 5104us (5311us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787853740.198932:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:1.0:1787853740.212301:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853740.212474:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136464000 00000100:00100000:2.0:1787853740.212484:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136464000 00000100:00100000:2.0:1787853740.212548:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:2.0:1787853740.212563:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748346940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+9:14436:x1874700136464000:12345-192.168.206.10@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787853740.213423:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748346940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+9:14436:x1874700136464000:12345-192.168.206.10@tcp:59:lhsmtool_posix.0 Request processed in 861us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853740.213434:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 17 00000100:00100000:2.0:1787853740.257099:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853740.257270:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136464128 00000100:00100000:1.0:1787853740.257278:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136464128 00000100:00100000:1.0:1787853740.257667:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:1.0:1787853740.257703:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+9:14442:x1874700136464128:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:1.0:1787853740.257723:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853740.257740:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb055d17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd241b expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.257801:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055d1e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.257814:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055d1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.257825:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055d1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.257839:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055d25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.257847:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055d25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.257853:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055d25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.258095:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055d1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.258103:0:14414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055d1e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.258121:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055d1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.258127:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197e00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853740.258131:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055d1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.258139:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055d1e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.258150:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992742cdd800) 00010000:00010000:1.0:1787853740.258153:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853740.258158:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055d1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.258164:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197e00/0xcf1365f7cb055d1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.258176:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055d25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.258182:0:14414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055d25 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.258187:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055d25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.258192:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853740.258195:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055d25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.258211:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055d25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.258219:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9927433f1100) 00010000:00010000:1.0:1787853740.258222:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853740.258225:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055d25 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.258231:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197c00/0xcf1365f7cb055d25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.258262:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb055d17 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd241b expref: 10 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.258274:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992742cdd800) 00010000:00010000:1.0:1787853740.258276:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853740.258280:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197400/0xcf1365f7cb055d17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd241b expref: 10 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.258289:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766197400, rc 0) 00000100:00100000:1.0:1787853740.258487:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+9:14442:x1874700136464128:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 791us (1395us total) trans 0 rc 301/301 00000100:00100000:1.0:1787853740.258496:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 18 00000100:00100000:0.0:1787853740.277642:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853740.277840:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136464256 00000100:00100000:1.0:1787853740.277850:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136464256 00000100:00100000:1.0:1787853740.277922:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:1.0:1787853740.277934:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+9:14442:x1874700136464256:12345-192.168.206.10@tcp:700:lfs.0 00000100:00100000:1.0:1787853740.278034:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+9:14442:x1874700136464256:12345-192.168.206.10@tcp:700:lfs.0 Request processed in 103us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853740.278043:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:0.0:1787853740.281059:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853740.281162:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136464512 00000100:00100000:2.0:1787853740.281171:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136464512 00000100:00100000:2.0:1787853740.281226:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 19 00000100:00100000:2.0:1787853740.281235:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+9:14442:x1874700136464512:12345-192.168.206.10@tcp:36:lfs.0 00010000:00010000:2.0:1787853740.281289:0:14413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853740.281317:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992641daec00/0xcf1365f7cb055c5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2396 expref: 9 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.281336:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992742cdd800) 00010000:00010000:2.0:1787853740.281458:0:14413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853740.281866:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fe00/0xcf1365f7cb055d2c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.281881:0:14413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055c92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23f8 expref: 5 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.281889:0:14413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fe00/0xcf1365f7cb055d2c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.281922:0:14413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055c92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23f8 expref: 5 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.281936:0:14413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055c92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23f8 expref: 5 pid: 14413 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853740.281965:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748385a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14413:1874700152180736:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787853740.282055:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff992775228300 going to sleep for 11 seconds 00000100:00100000:2.0:1787853740.290992:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853740.291076:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136464640 00000100:00100000:0.0:1787853740.291082:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136464640 00000100:00100000:1.0:1787853740.291092:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748385a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14413:1874700152180736:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787853740.291118:0:14413:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fe00/0xcf1365f7cb055d2c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853740.291227:0:14398:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055c92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23f8 expref: 6 pid: 14413 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853740.291264:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:0.0:1787853740.291273:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748386d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+6:2365:x1874700136464640:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853740.291287:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853740.291294:0:14398:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055c92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23f8 expref: 6 pid: 14413 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853740.291306:0:14398:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055c92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23f8 expref: 6 pid: 14413 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853740.291329:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055c92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd23f8 expref: 6 pid: 14413 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853740.291345:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992742cdd800) 00010000:00010000:0.0:1787853740.291350:0:14398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fe00/0xcf1365f7cb055d2c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853740.291370:0:14398:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fe00/0xcf1365f7cb055d2c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853740.291394:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fe00/0xcf1365f7cb055d2c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853740.291499:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787853740.291566:0:14413:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fe00/0xcf1365f7cb055d2c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.291574:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fe00/0xcf1365f7cb055d2c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853740.291578:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748386d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+5:2365:x1874700136464640:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 306us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853740.291585:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00010000:00010000:3.0:1787853740.291697:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055d33 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.291708:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055d33 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.291723:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055d33 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787853740.291940:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1787853740.295276:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787853740.295292:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fe00/0xcf1365f7cb055d2c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.295303:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fe00/0xcf1365f7cb055d2c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.295311:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fe00/0xcf1365f7cb055d2c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.295317:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318fe00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853740.295322:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fe00/0xcf1365f7cb055d2c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.295329:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fe00/0xcf1365f7cb055d2c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.295345:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992742cdd800) 00010000:00010000:3.0:1787853740.295348:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853740.295352:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fe00/0xcf1365f7cb055d2c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.295358:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fe00/0xcf1365f7cb055d2c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787853740.295377:0:14413:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a6b8aa9 reply state 00000000ed1c5eb7 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055d33 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853740.295399:0:14413:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787853740.296224:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+10:14442:x1874700136464512:12345-192.168.206.10@tcp:36:lfs.0 Request processed in 14984us (15168us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787853740.296234:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 19 00010000:00010000:0.0:1787853740.305265:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055d33 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853740.305285:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055d33 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853740.305294:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055d33 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853740.305301:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992641daea00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:0.0:1787853740.305306:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055d33 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853740.305315:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055d33 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853740.305333:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff992742cdd300) 00010000:00010000:0.0:1787853740.305336:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787853740.305341:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055d33 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853740.305349:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055d33 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853740.406451:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853740.406629:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136464768 00000100:00100000:3.0:1787853740.406639:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136464768 00000100:00100000:3.0:1787853740.406795:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:3.0:1787853740.406807:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+9:14450:x1874700136464768:12345-192.168.206.10@tcp:101:lctl.0 00010000:00010000:3.0:1787853740.406829:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853740.406850:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055d3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2422 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.407212:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992641dae400/0xcf1365f7cb055d41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.407228:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992641dae400/0xcf1365f7cb055d41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.407240:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641dae400/0xcf1365f7cb055d41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853740.407298:0:14415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787853740.407302:0:14415:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853740.407345:0:14415:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992641dae400/0xcf1365f7cb055d41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.407370:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055d3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2422 expref: 11 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.407388:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992641dae400/0xcf1365f7cb055d41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2422 expref: 10 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.407396:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992742cdd800) 00010000:00010000:2.0:1787853740.407398:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853740.407402:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992641dae400, rc 0) 00000100:00100000:2.0:1787853740.407504:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+10:14450:x1874700136464768:12345-192.168.206.10@tcp:101:lctl.0 Request processed in 699us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853740.407538:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 20 00000100:00100000:2.0:1787853740.430823:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853740.431027:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136464896 00000100:00100000:3.0:1787853740.431037:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136464896 00000100:00100000:3.0:1787853740.431093:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:3.0:1787853740.431104:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748385680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+5:14451:x1874700136464896:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787853740.431122:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853740.431141:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641dae200/0xcf1365f7cb055d48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2429 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.431201:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992641daee00/0xcf1365f7cb055d4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.431357:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992641daee00/0xcf1365f7cb055d4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.431373:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641daee00/0xcf1365f7cb055d4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853740.431442:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787853740.431446:0:14413:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853740.431471:0:14413:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992641daee00/0xcf1365f7cb055d4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.431496:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992641dae200/0xcf1365f7cb055d48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2429 expref: 7 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.431513:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992641daee00/0xcf1365f7cb055d4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2429 expref: 6 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.431599:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992742cdd800) 00010000:00010000:3.0:1787853740.431602:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787853740.431605:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992641daee00, rc 0) 00000100:00100000:3.0:1787853740.431756:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748385680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+6:14451:x1874700136464896:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 652us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853740.431764:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 21 00000100:00100000:3.0:1787853740.439434:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853740.439608:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136465024 00000100:00100000:2.0:1787853740.439617:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136465024 00000100:00100000:2.0:1787853740.439712:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:2.0:1787853740.439723:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:753260b7-c4c7-459e-9b8b-963f01a57f0c+6:14451:x1874700136465024:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787853740.439740:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853740.439758:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f000/0xcf1365f7cb055d56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2430 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.439833:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055d5d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.439848:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055d5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.439859:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055d5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.439875:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055d64 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.439882:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055d64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.439895:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055d64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.440082:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fa00/0xcf1365f7cb055d6b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.440110:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fa00/0xcf1365f7cb055d6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.440120:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fa00/0xcf1365f7cb055d6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853740.440251:0:14415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787853740.440255:0:14415:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853740.440426:0:14415:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fa00/0xcf1365f7cb055d6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.440440:0:14415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055d5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.440446:0:14415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055d5d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.440453:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055d5d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.440459:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318e400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853740.440463:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055d5d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.440471:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055d5d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.440483:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992742cdd800) 00010000:00010000:2.0:1787853740.440487:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853740.440491:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055d5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.440510:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055d5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.440534:0:14415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055d64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.440541:0:14415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055d64 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.440547:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055d64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.440552:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318e200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853740.440751:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055d64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.440760:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055d64 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.440769:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff992742df7900) 00010000:00010000:2.0:1787853740.440772:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853740.440775:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055d64 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.440781:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055d64 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.441139:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f000/0xcf1365f7cb055d56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2430 expref: 8 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.441177:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fa00/0xcf1365f7cb055d6b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2430 expref: 7 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.441190:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff992742df7000) 00010000:00010000:2.0:1787853740.441193:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853740.441195:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99264318fa00, rc 0) 00000100:00100000:2.0:1787853740.441541:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:753260b7-c4c7-459e-9b8b-963f01a57f0c+7:14451:x1874700136465024:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1818us (2114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853740.441550:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 22 00000100:00100000:1.0:1787853740.450415:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853740.451716:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136465280 00000100:00100000:3.0:1787853740.451728:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136465280 00000100:00100000:3.0:1787853740.451830:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:3.0:1787853740.451841:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748344f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+7:14451:x1874700136465280:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787853740.451860:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853740.451879:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641dae200/0xcf1365f7cb055d72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2437 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853740.451982:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787853740.452127:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992641dae200/0xcf1365f7cb055d72 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2437 expref: 9 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.452141:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992742cdd800) 00010000:00010000:3.0:1787853740.452145:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787853740.452150:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992641dae200/0xcf1365f7cb055d72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2437 expref: 9 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.452163:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992641dae200, rc 0) 00000100:00100000:3.0:1787853740.452227:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748344f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+8:14451:x1874700136465280:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 388us (1821us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1787853740.452235:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 23 00000100:00100000:0.0:1787853740.457279:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853740.457438:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136465536 00000100:00100000:2.0:1787853740.457448:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136465536 00000100:00100000:2.0:1787853740.457539:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 24 00000100:00100000:2.0:1787853740.457555:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:753260b7-c4c7-459e-9b8b-963f01a57f0c+8:14451:x1874700136465536:12345-192.168.206.10@tcp:36:lfs.0 00010000:00010000:2.0:1787853740.457638:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853740.457668:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fa00/0xcf1365f7cb055d6b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2430 expref: 8 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.457726:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff992742df7000) 00010000:00010000:2.0:1787853740.457737:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853740.457761:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f000/0xcf1365f7cb055d80 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.457774:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f000/0xcf1365f7cb055d80 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.457783:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f000/0xcf1365f7cb055d80 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787853740.458011:0:14415:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000494959f2 reply state 0000000084ad90f6 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f000/0xcf1365f7cb055d80 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853740.458021:0:14415:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787853740.458034:0:14415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1787853740.458105:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:753260b7-c4c7-459e-9b8b-963f01a57f0c+9:14451:x1874700136465536:12345-192.168.206.10@tcp:36:lfs.0 Request processed in 553us (841us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787853740.458113:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 24 00010000:00010000:3.0:1787853740.460761:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f000/0xcf1365f7cb055d80 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.460777:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f000/0xcf1365f7cb055d80 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.460785:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f000/0xcf1365f7cb055d80 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.460791:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318f000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853740.460795:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f000/0xcf1365f7cb055d80 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.460803:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f000/0xcf1365f7cb055d80 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.460818:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff992742df7900) 00010000:00010000:3.0:1787853740.460821:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787853740.460838:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f000/0xcf1365f7cb055d80 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.460844:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f000/0xcf1365f7cb055d80 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853740.468224:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853740.469189:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136465792 00000100:00100000:0.0:1787853740.469200:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136465792 00000100:00100000:0.0:1787853740.469274:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:0.0:1787853740.469285:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748387840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+8:14451:x1874700136465792:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:0.0:1787853740.469587:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748387840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+9:14451:x1874700136465792:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 302us (1370us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787853740.469757:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:0.0:1787853740.475039:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853740.475451:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136466048 00000100:00100000:3.0:1787853740.475461:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136466048 00000100:00100000:3.0:1787853740.475534:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:3.0:1787853740.475545:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+9:14451:x1874700136466048:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:3.0:1787853740.475568:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853740.475591:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641dae200/0xcf1365f7cb055d87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd243e expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.475663:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055d8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.475713:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055d8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.475724:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055d8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.475740:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055d95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.475746:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055d95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.475752:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055d95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853740.475893:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787853740.475988:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055d8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.475996:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055d8e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.476014:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055d8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.476020:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992641daf800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853740.476025:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055d8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.476032:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055d8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.476044:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992742cdd800) 00010000:00010000:3.0:1787853740.476047:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853740.476051:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055d8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.476057:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055d8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.476070:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055d95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.476076:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055d95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.476091:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055d95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.476096:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992641daea00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853740.476099:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055d95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.476105:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055d95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.476114:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff992742cdd500) 00010000:00010000:3.0:1787853740.476116:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853740.476119:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055d95 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.476125:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055d95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.476164:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992641dae200/0xcf1365f7cb055d87 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd243e expref: 11 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.476175:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992742cdd800) 00010000:00010000:3.0:1787853740.476177:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787853740.476181:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992641dae200/0xcf1365f7cb055d87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd243e expref: 11 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.476190:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992641dae200, rc 0) 00000100:00100000:3.0:1787853740.477222:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+10:14451:x1874700136466048:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 1674us (2186us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1787853740.477253:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 25 00000100:00100000:1.0:1787853740.489922:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853740.490026:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136466176 00000100:00100000:2.0:1787853740.490036:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136466176 00000100:00100000:2.0:1787853740.490134:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00100000:2.0:1787853740.490144:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:753260b7-c4c7-459e-9b8b-963f01a57f0c+10:14451:x1874700136466176:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787853740.490167:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853740.490190:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055da3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2445 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.490290:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055daa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.490304:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055daa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.490316:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055daa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853740.490379:0:14414:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787853740.490383:0:14414:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853740.490425:0:14414:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055daa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.490452:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055da3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2445 expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.490469:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055daa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2445 expref: 11 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.490477:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff992742df7000) 00010000:00010000:2.0:1787853740.490480:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787853740.490484:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99264318e400, rc 0) 00000100:00100000:2.0:1787853740.490572:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:753260b7-c4c7-459e-9b8b-963f01a57f0c+11:14451:x1874700136466176:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 430us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853740.490580:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 26 00000100:00100000:2.0:1787853740.502052:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853740.502136:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136466304 00000100:00100000:0.0:1787853740.502145:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136466304 00000100:00100000:0.0:1787853740.502197:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:0.0:1787853740.502208:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+11:14451:x1874700136466304:12345-192.168.206.10@tcp:37:lfs.0 00000100:00100000:2.0:1787853740.516334:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:753260b7-c4c7-459e-9b8b-963f01a57f0c+11:14451:x1874700136466304:12345-192.168.206.10@tcp:37:lfs.0 Request processed in 14118us (14282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853740.516347:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:1.0:1787853740.524264:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853740.524382:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136466560 00000100:00100000:2.0:1787853740.524392:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136466560 00000100:00100000:2.0:1787853740.524492:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:2.0:1787853740.524502:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744074850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:753260b7-c4c7-459e-9b8b-963f01a57f0c+11:14451:x1874700136466560:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787853740.524846:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744074850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:753260b7-c4c7-459e-9b8b-963f01a57f0c+12:14451:x1874700136466560:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 345us (589us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787853740.524855:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:0.0:1787853740.627451:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853740.627659:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136466688 00000100:00100000:3.0:1787853740.627715:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136466688 00000100:00100000:3.0:1787853740.627775:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:3.0:1787853740.627785:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+10:14457:x1874700136466688:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:3.0:1787853740.627805:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853740.627824:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055db1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd244c expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.627904:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055db8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.627919:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055db8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.627929:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055db8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.627945:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055dbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.627952:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055dbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.627959:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055dbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.628077:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992641daec00/0xcf1365f7cb055dc6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.628096:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992641daec00/0xcf1365f7cb055dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.628105:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641daec00/0xcf1365f7cb055dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853740.628137:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787853740.628142:0:14413:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787853740.628183:0:14413:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992641daec00/0xcf1365f7cb055dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.628195:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055db8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.628202:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055db8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.628208:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055db8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.628214:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992641daf800 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853740.628218:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055db8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.628226:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055db8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.628237:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992742cdd800) 00010000:00010000:3.0:1787853740.628240:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853740.628244:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055db8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.628261:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055db8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.628276:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055dbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.628282:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055dbf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.628288:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055dbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.628293:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992641dafa00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853740.628296:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055dbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.628301:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055dbf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.628309:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff992742cdd500) 00010000:00010000:3.0:1787853740.628311:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853740.628314:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055dbf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.628319:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055dbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.628348:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055db1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd244c expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.628374:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992641daec00/0xcf1365f7cb055dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd244c expref: 11 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.628381:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff992742df7000) 00010000:00010000:3.0:1787853740.628383:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787853740.628385:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992641daec00, rc 0) 00000100:00100000:3.0:1787853740.628438:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+11:14457:x1874700136466688:12345-192.168.206.10@tcp:101:bash.0 Request processed in 655us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853740.628445:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 27 00000100:00100000:3.0:1787853740.637620:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853740.637735:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136466944 00000100:00100000:2.0:1787853740.637755:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136466944 00000100:00100000:2.0:1787853740.637813:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 28 00000100:00100000:2.0:1787853740.637823:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+11:14457:x1874700136466944:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:2.0:1787853740.637843:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853740.637863:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055dcd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2453 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.637983:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055dd4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.638013:0:14414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055daa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2445 expref: 11 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.638023:0:14414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055dd4 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.638062:0:14414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055daa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2445 expref: 11 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.638077:0:14414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055daa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2445 expref: 11 pid: 14414 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853740.638090:0:14414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748387840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14414:1874700152180864:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787853740.638179:0:14414:0:(client.c:2715:ptlrpc_set_wait()) set ffff992775228240 going to sleep for 11 seconds 00000100:00100000:0.0:1787853740.645328:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853740.645493:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136467072 00000100:00100000:3.0:1787853740.645501:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136467072 00010000:00010000:3.0:1787853740.645556:0:14400:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055daa lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2445 expref: 12 pid: 14414 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853740.645599:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:3.0:1787853740.645610:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:753260b7-c4c7-459e-9b8b-963f01a57f0c+12:2364:x1874700136467072:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853740.645624:0:14400:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853740.645630:0:14400:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055daa lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2445 expref: 12 pid: 14414 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.645643:0:14400:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055daa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2445 expref: 12 pid: 14414 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.645667:0:14400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff992742df7000) 00010000:00010000:3.0:1787853740.645769:0:14400:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055dd4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.645780:0:14400:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.645787:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055dd4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853740.645806:0:14400:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853740.645951:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:753260b7-c4c7-459e-9b8b-963f01a57f0c+12:2364:x1874700136467072:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 342us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853740.645959:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00010000:00010000:2.0:1787853740.647635:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055daa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2445 expref: 11 pid: 14414 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853740.647660:0:14414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748387840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14414:1874700152180864:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787853740.647743:0:14414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.647754:0:14414:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.647760:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.647792:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e600/0xcf1365f7cb055ddb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.647804:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e600/0xcf1365f7cb055ddb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.647814:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e600/0xcf1365f7cb055ddb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.648659:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ee00/0xcf1365f7cb055de2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.648702:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ee00/0xcf1365f7cb055de2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.648712:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ee00/0xcf1365f7cb055de2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853740.648723:0:14414:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787853740.648749:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055dd4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.648756:0:14414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055dd4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.648773:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055dd4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.648779:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318ea00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853740.648783:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055dd4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.648790:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055dd4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.648801:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff992742df7000) 00010000:00010000:2.0:1787853740.648804:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853740.648808:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055dd4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.648814:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055dd4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787853740.648826:0:14414:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000775fe494 reply state 000000006dee41ba transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e600/0xcf1365f7cb055ddb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853740.648834:0:14414:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787853740.648865:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055dcd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2453 expref: 14 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.648878:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ee00/0xcf1365f7cb055de2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2453 expref: 13 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.648885:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff992742df7200) 00010000:00010000:2.0:1787853740.648892:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787853740.648895:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99264318ee00, rc 0) 00000100:00100000:2.0:1787853740.648968:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+14:14457:x1874700136466944:12345-192.168.206.10@tcp:101:bash.0 Request processed in 11145us (11355us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787853740.648977:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 28 00010000:00010000:2.0:1787853740.651900:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e600/0xcf1365f7cb055ddb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.651916:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e600/0xcf1365f7cb055ddb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.651922:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e600/0xcf1365f7cb055ddb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.651928:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318e600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853740.651932:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e600/0xcf1365f7cb055ddb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.651939:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e600/0xcf1365f7cb055ddb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.651956:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff992742df7300) 00010000:00010000:2.0:1787853740.651959:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787853740.651964:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e600/0xcf1365f7cb055ddb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.651969:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e600/0xcf1365f7cb055ddb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853740.669213:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853740.669837:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136467200 00000100:00100000:2.0:1787853740.669846:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136467200 00000100:00100000:2.0:1787853740.669919:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:2.0:1787853740.669928:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748346d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+13:14457:x1874700136467200:12345-192.168.206.10@tcp:101:bash.0 00010000:00010000:2.0:1787853740.669949:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853740.669967:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e600/0xcf1365f7cb055df0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd245a expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.670025:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055df7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.670038:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055df7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.670048:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055df7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853740.670082:0:14415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787853740.670085:0:14415:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853740.670099:0:14415:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055df7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.670216:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055df7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.670239:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e600/0xcf1365f7cb055df0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd245a expref: 15 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.670257:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055df7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd245a expref: 14 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.670266:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff992742df7200) 00010000:00010000:2.0:1787853740.670274:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853740.670277:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99264318e200, rc 0) 00000100:00100000:2.0:1787853740.670334:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748346d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+14:14457:x1874700136467200:12345-192.168.206.10@tcp:101:bash.0 Request processed in 406us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853740.670341:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 29 00000100:00100000:0.0:1787853740.674637:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853740.674832:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136467456 00000100:00100000:2.0:1787853740.674841:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136467456 00000100:00100000:2.0:1787853740.674896:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:2.0:1787853740.674907:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+14:14457:x1874700136467456:12345-192.168.206.10@tcp:35:bash.0 00000100:00100000:2.0:1787853740.675224:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+15:14457:x1874700136467456:12345-192.168.206.10@tcp:35:bash.0 Request processed in 318us (594us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787853740.675233:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:0.0:1787853740.785060:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853740.785169:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136467712 00000100:00100000:2.0:1787853740.785177:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136467712 00000100:00100000:2.0:1787853740.785232:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 30 00000100:00100000:2.0:1787853740.785240:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+15:14467:x1874700136467712:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787853740.785261:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853740.785278:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e600/0xcf1365f7cb055dfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2461 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853740.785382:0:14414:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787853740.785499:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e600/0xcf1365f7cb055dfe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2461 expref: 17 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.785512:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff992742cdd800) 00010000:00010000:2.0:1787853740.785514:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787853740.785535:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e600/0xcf1365f7cb055dfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2461 expref: 17 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.785564:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99264318e600, rc 0) 00000100:00100000:2.0:1787853740.785622:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+16:14467:x1874700136467712:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 382us (570us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787853740.785630:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 30 00000100:00100000:1.0:1787853740.790925:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853740.791057:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136467968 00000100:00100000:3.0:1787853740.791067:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136467968 00000100:00100000:3.0:1787853740.791130:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:3.0:1787853740.791139:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748346580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+16:14467:x1874700136467968:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:3.0:1787853740.791376:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748346580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+17:14467:x1874700136467968:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 237us (458us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787853740.791383:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:0.0:1787853740.844621:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853740.848063:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136468224 00000100:00100000:3.0:1787853740.848077:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136468224 00000100:00100000:2.0:1787853740.849759:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 31 00000100:00100000:2.0:1787853740.849773:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+17:14470:x1874700136468224:12345-192.168.206.10@tcp:101:lfs.0 00010000:00010000:2.0:1787853740.849799:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853740.849820:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e600/0xcf1365f7cb055e0c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2468 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.849925:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055e13 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.849939:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055e13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.849952:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055e13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853740.849963:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787853740.850094:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e600/0xcf1365f7cb055e0c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2468 expref: 20 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.850117:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055e13 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2468 expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853740.850125:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff992742df7200) 00010000:00010000:2.0:1787853740.850141:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853740.850146:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99264318ea00, rc 0) 00000100:00100000:2.0:1787853740.850279:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+19:14470:x1874700136468224:12345-192.168.206.10@tcp:101:lfs.0 Request processed in 509us (5666us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787853740.850287:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 31 00000100:00100000:0.0:1787853740.856797:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853740.857095:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136468352 00000100:00100000:1.0:1787853740.857104:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136468352 00000100:00100000:1.0:1787853740.857179:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:1.0:1787853740.857191:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+19:14470:x1874700136468352:12345-192.168.206.10@tcp:54:lfs.0 00010000:00010000:1.0:1787853740.858506:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055e21 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.858537:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055e21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.858549:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055e21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.858579:0:14415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055e21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.858603:0:14415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055e21 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.858610:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055e21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.858616:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853740.858620:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055e21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.858627:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055e21 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.858639:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff992742df7200) 00010000:00010000:1.0:1787853740.858641:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787853740.858645:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055e21 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.858651:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055e21 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853740.858749:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+19:14470:x1874700136468352:12345-192.168.206.10@tcp:54:lfs.0 Request processed in 1558us (1957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853740.858758:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 32 00000100:00100000:3.0:1787853740.863461:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853740.863547:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136468608 00000100:00100000:2.0:1787853740.863556:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136468608 00000100:00100000:2.0:1787853740.863612:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:2.0:1787853740.863623:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+19:14470:x1874700136468608:12345-192.168.206.10@tcp:35:lfs.0 00000100:00100000:2.0:1787853740.863894:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+20:14470:x1874700136468608:12345-192.168.206.10@tcp:35:lfs.0 Request processed in 272us (441us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787853740.863903:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:0.0:1787853740.865325:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853740.865429:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136468736 00000100:00100000:1.0:1787853740.865436:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136468736 00000100:00100000:1.0:1787853740.865514:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:1.0:1787853740.865537:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+20:2363:x1874700136468736:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787853740.865551:0:14399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853740.865589:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055e13 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2468 expref: 20 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853740.865608:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff992742df7200) 00010000:00010000:1.0:1787853740.865613:0:14399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787853740.865661:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+19:2363:x1874700136468736:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 129us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853740.865669:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00010000:00010000:2.0:1787853740.870022:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787853740.994053:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853740.994099:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853740.994128:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853740.994151:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853740.994174:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853740.994196:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136469120 00000100:00100000:1.0:1787853740.994204:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136469120 00000100:00100000:1.0:1787853740.994250:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136469376 00000100:00100000:1.0:1787853740.994252:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136469376 00000100:00100000:1.0:1787853740.994276:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136468992 00000100:00100000:1.0:1787853740.994278:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136468992 00000100:00100000:1.0:1787853740.994288:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136469248 00000100:00100000:1.0:1787853740.994290:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136469248 00000100:00100000:1.0:1787853740.994303:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:1.0:1787853740.994311:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748344b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+5:2363:x1874700136469120:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853740.994373:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748344b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+5:2363:x1874700136469120:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 63us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853740.994381:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:1.0:1787853740.994398:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:1.0:1787853740.994407:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:753260b7-c4c7-459e-9b8b-963f01a57f0c+5:2363:x1874700136469376:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853740.994446:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:753260b7-c4c7-459e-9b8b-963f01a57f0c+5:2363:x1874700136469376:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 42us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853740.994452:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:1.0:1787853740.994464:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:1.0:1787853740.994473:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748345a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+5:2363:x1874700136468992:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853740.994495:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748345a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+5:2363:x1874700136468992:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853740.994501:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:1.0:1787853740.994511:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:1.0:1787853740.994530:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748347c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:753260b7-c4c7-459e-9b8b-963f01a57f0c+5:2363:x1874700136469248:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:1.0:1787853740.994562:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748347c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:753260b7-c4c7-459e-9b8b-963f01a57f0c+5:2363:x1874700136469248:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 45us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853740.994568:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00080000:1.0:1787853740.994587:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787853740.994590:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787853740.994914:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136468864 00000100:00100000:2.0:1787853740.994919:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136468864 00000100:00100000:2.0:1787853740.994957:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 121 00000100:00100000:2.0:1787853740.994964:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbd02cf6-06c8-4693-a133-376b55bc6797+13:2363:x1874700136468864:12345-192.168.206.10@tcp:400:kworker.0 00000100:00100000:2.0:1787853740.995001:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bbd02cf6-06c8-4693-a133-376b55bc6797+13:2363:x1874700136468864:12345-192.168.206.10@tcp:400:kworker.0 Request processed in 38us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853740.995008:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 121 00000100:00100000:1.0:1787853741.117039:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853741.117212:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136469632 00000100:00100000:3.0:1787853741.117221:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136469632 00000100:00100000:3.0:1787853741.117281:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:3.0:1787853741.117290:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748344780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+19:14501:x1874700136469632:12345-192.168.206.10@tcp:101:cat.0 00010000:00010000:3.0:1787853741.117312:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853741.117331:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf000/0xcf1365f7cb055e28 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd246f expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853741.117445:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055e2f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853741.117460:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055e2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853741.117472:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055e2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853741.117483:0:14414:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787853741.117931:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf000/0xcf1365f7cb055e28 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd246f expref: 22 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853741.117951:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055e2f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd246f expref: 21 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853741.117960:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff992742df7200) 00010000:00010000:3.0:1787853741.117963:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787853741.117966:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992641daf800, rc 0) 00000100:00100000:3.0:1787853741.118028:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748344780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+21:14501:x1874700136469632:12345-192.168.206.10@tcp:101:cat.0 Request processed in 739us (997us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1787853741.118036:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 33 00000100:00100000:3.0:1787853741.122175:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853741.122239:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853741.122333:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136469888 00000100:00100000:2.0:1787853741.122343:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136469888 00000100:00100000:2.0:1787853741.122411:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:2.0:1787853741.122421:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+21:14501:x1874700136469888:12345-192.168.206.10@tcp:35:cat.0 00000100:00100000:2.0:1787853741.122780:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+22:14501:x1874700136469888:12345-192.168.206.10@tcp:35:cat.0 Request processed in 360us (613us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787853741.122801:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 8 00000100:00100000:0.0:1787853741.123061:0:16528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136470016 00000100:00100000:0.0:1787853741.123066:0:16528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136470016 00000100:00100000:0.0:1787853741.123122:0:16528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:0.0:1787853741.123131:0:16528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d371ba61-36c8-41b1-a7d1-25796dee8fd1+22:2364:x1874700136470016:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853741.123192:0:16528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853741.123224:0:16528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf800/0xcf1365f7cb055e2f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd246f expref: 22 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853741.123242:0:16528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff992742df7200) 00010000:00010000:0.0:1787853741.123248:0:16528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853741.123330:0:16528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d371ba61-36c8-41b1-a7d1-25796dee8fd1+21:2364:x1874700136470016:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 199us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853741.123338:0:16528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:3.0:1787853741.189727:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853741.189788:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136470272 00000100:00100000:1.0:1787853741.189798:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136470272 00000100:00100000:1.0:1787853741.189870:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:1.0:1787853741.189883:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+21:14507:x1874700136470272:12345-192.168.206.10@tcp:101:dd.0 00010000:00010000:1.0:1787853741.189905:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853741.190204:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb055e3d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2476 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853741.190296:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb055e44 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853741.190323:0:14415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ee00/0xcf1365f7cb055de2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2453 expref: 22 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853741.190331:0:14415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055df7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd245a expref: 22 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853741.190338:0:14415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb055e44 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853741.190368:0:14415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055df7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd245a expref: 22 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853741.190381:0:14415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055df7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd245a expref: 22 pid: 14415 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853741.190394:0:14415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748345680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14415:1874700152180992:192.168.206.10@tcp:104: 00000040:00080000:0.0:1787853741.190432:0:14445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787853741.190506:0:14415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ee00/0xcf1365f7cb055de2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2453 expref: 22 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853741.190527:0:14415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ee00/0xcf1365f7cb055de2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2453 expref: 22 pid: 14414 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853741.190537:0:14415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c78f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14415:1874700152181120:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787853741.190563:0:14415:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927412549c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787853741.200929:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853741.201014:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136470400 00000100:00100000:0.0:1787853741.201023:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136470400 00010000:00010000:0.0:1787853741.201060:0:14398:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055df7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd245a expref: 23 pid: 14415 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853741.201107:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:0.0:1787853741.201117:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9926435a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+23:2362:x1874700136470400:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853741.201130:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853741.201136:0:14398:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055df7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd245a expref: 23 pid: 14415 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853741.201150:0:14398:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055df7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd245a expref: 23 pid: 14415 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853741.201170:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff992742df7200) 00010000:00010000:0.0:1787853741.201176:0:14398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb055e44 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853741.201183:0:14398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb055e44 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853741.201201:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853741.201262:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9926435a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+23:2362:x1874700136470400:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 146us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853741.201278:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00010000:00010000:2.0:1787853741.201415:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e200/0xcf1365f7cb055df7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd245a expref: 22 pid: 14415 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853741.201434:0:14415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748345680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14415:1874700152180992:192.168.206.10@tcp:104: 00000100:00100000:2.0:1787853741.201447:0:14415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c78f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14415:1874700152181120:192.168.206.10@tcp:104: 00010000:00010000:2.0:1787853741.201482:0:14415:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb055e44 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853741.202568:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853741.202795:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136470528 00000100:00100000:2.0:1787853741.202802:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136470528 00010000:00010000:2.0:1787853741.202831:0:14400:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ee00/0xcf1365f7cb055de2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2453 expref: 22 pid: 14414 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853741.202868:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 12 00000100:00100000:2.0:1787853741.202877:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+22:2364:x1874700136470528:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853741.202889:0:14400:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853741.202895:0:14400:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ee00/0xcf1365f7cb055de2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2453 expref: 22 pid: 14414 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853741.202907:0:14400:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ee00/0xcf1365f7cb055de2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2453 expref: 22 pid: 14414 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853741.202926:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ee00/0xcf1365f7cb055de2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2453 expref: 22 pid: 14414 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853741.202966:0:14400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff992742df7200) 00010000:00010000:2.0:1787853741.202970:0:14400:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb055e44 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853741.202978:0:14400:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb055e44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853741.202985:0:14400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb055e44 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853741.203020:0:14400:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853741.203064:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+21:2364:x1874700136470528:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 188us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853741.203072:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 12 00010000:00010000:3.0:1787853741.203512:0:14415:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb055e44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853741.203538:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb055e44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787853741.203556:0:14415:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787853741.203891:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb055e3d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2476 expref: 22 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853741.203906:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197600/0xcf1365f7cb055e44 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2476 expref: 21 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853741.203914:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff992742df7200) 00010000:00010000:3.0:1787853741.203917:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787853741.203920:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766197600, rc 0) 00000100:00100000:3.0:1787853741.203973:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+21:14507:x1874700136470272:12345-192.168.206.10@tcp:101:dd.0 Request processed in 14093us (14255us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1787853741.203980:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 34 00000100:00100000:1.0:1787853741.209305:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853741.209392:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136470784 00000100:00100000:3.0:1787853741.209401:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136470784 00000100:00100000:3.0:1787853741.209454:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 35 00000100:00100000:3.0:1787853741.209464:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+21:14507:x1874700136470784:12345-192.168.206.10@tcp:36:dd.0 00010000:00010000:3.0:1787853741.209952:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e52 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853741.209968:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853741.209979:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787853741.210042:0:14414:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1787853741.210071:0:14414:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a547ef94 reply state 0000000000f5c2d0 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853741.210080:0:14414:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787853741.210175:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+24:14507:x1874700136470784:12345-192.168.206.10@tcp:36:dd.0 Request processed in 711us (987us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1787853741.210183:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 35 00000020:00080000:3.0:1787853741.210188:0:14414:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787853741.215257:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853741.215274:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e52 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853741.215281:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e52 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853741.215286:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992641dafa00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853741.215291:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e52 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853741.215298:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e52 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853741.215314:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff992742df7200) 00010000:00010000:3.0:1787853741.215316:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853741.215321:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e52 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853741.215326:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e52 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853741.216017:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853741.216102:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136470912 00000100:00100000:3.0:1787853741.216111:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136470912 00000100:00100000:3.0:1787853741.216159:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:3.0:1787853741.216168:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c78f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+23:14507:x1874700136470912:12345-192.168.206.10@tcp:101:dd.0 00010000:00010000:3.0:1787853741.216188:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787853741.216204:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055e59 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd247d expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853741.216254:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055e59 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd247d expref: 24 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853741.216267:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055e59 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd247d expref: 24 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853741.216284:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff992742df7200) 00010000:00010000:3.0:1787853741.216286:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787853741.216289:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992641daea00, rc 0) 00000100:00100000:3.0:1787853741.216350:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c78f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+24:14507:x1874700136470912:12345-192.168.206.10@tcp:101:dd.0 Request processed in 183us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853741.216357:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 36 00000100:00100000:2.0:1787853741.233362:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853741.233446:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136471168 00000100:00100000:0.0:1787853741.233455:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136471168 00000100:00100000:0.0:1787853741.233533:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:0.0:1787853741.233544:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748387840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+24:14507:x1874700136471168:12345-192.168.206.10@tcp:103:dd.0 00010000:00010000:0.0:1787853741.233559:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853741.233584:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055e59 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd247d expref: 24 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853741.233603:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff992742df7200) 00010000:00010000:0.0:1787853741.233608:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853741.233816:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748387840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+23:14507:x1874700136471168:12345-192.168.206.10@tcp:103:dd.0 Request processed in 273us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853741.233824:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:0.0:1787853741.236326:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853741.236412:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136471296 00000100:00100000:3.0:1787853741.236420:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136471296 00000100:00100000:3.0:1787853741.236477:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:3.0:1787853741.236487:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+23:14507:x1874700136471296:12345-192.168.206.10@tcp:58:dd.0 00010000:00010000:3.0:1787853741.236612:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e60 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853741.236637:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e60 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853741.236649:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e60 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787853741.239176:0:14414:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787853741.239345:0:14414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1787853741.239420:0:14414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1787853741.239549:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+23:14507:x1874700136471296:12345-192.168.206.10@tcp:58:dd.0 Request processed in 3058us (3226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853741.239560:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 37 00000100:00100000:2.0:1787853741.244883:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853741.246146:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136471424 00000100:00100000:1.0:1787853741.246156:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136471424 00000100:00100000:1.0:1787853741.246224:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:1.0:1787853741.246234:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+23:14507:x1874700136471424:12345-192.168.206.10@tcp:101:dd.0 00010000:00010000:1.0:1787853741.246252:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853741.246273:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb055e67 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2484 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853741.246328:0:14413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e60 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853741.246338:0:14413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb055e67 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2484 expref: 24 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853741.246362:0:14413:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e60 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853741.246376:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb055e67 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2484 expref: 24 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853741.246389:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff992742df7200) 00010000:00010000:1.0:1787853741.246392:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787853741.246396:0:14413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb055e67 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2484 expref: 24 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853741.246405:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766197800, rc 0) 00000100:00100000:1.0:1787853741.246472:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+24:14507:x1874700136471424:12345-192.168.206.10@tcp:101:dd.0 Request processed in 239us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853741.246495:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 38 00000100:00100000:1.0:1787853741.382001:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152181376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787853741.382059:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99264227f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152181632:0@lo:400:kworker.0 00000100:00100000:1.0:1787853741.382083:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853741.382139:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99264227fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3299:1874700152181248:0@lo:400:kworker.0 00000100:00100000:2.0:1787853741.383385:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99264227e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152181504:0@lo:400:kworker.0 00000100:00100000:0.0:1787853741.383886:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853741.383953:0:3298:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927483861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152182144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853741.383989:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853741.384028:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152181376 00000100:00100000:0.0:1787853741.384159:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152181376 00000100:00100000:0.0:1787853741.384209:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152182144 00000100:00100000:0.0:1787853741.384225:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152182144 00000100:00100000:0.0:1787853741.384246:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787853741.384255:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152181376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787853741.384291:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853741.384333:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152181376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (2251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853741.384340:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787853741.384358:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787853741.384364:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152182144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787853741.384381:0:15097:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787853741.384411:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152182144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853741.384417:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1787853741.384431:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787853741.384434:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787853741.384470:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927483861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152182144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787853741.384527:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152181632 00000100:00100000:0.0:1787853741.384531:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152181632 00000100:00100000:0.0:1787853741.384556:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787853741.384562:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152181632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853741.384596:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874700152181632:12345-0@lo:400:kworker.0 Request processed in 34us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853741.384602:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787853741.384625:0:3298:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99264227f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3298:1874700152181632:0@lo:400:kworker.0 00000100:00100000:1.0:1787853741.388534:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152181376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787853741.388572:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99264227ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1874700152181888:0@lo:400:kworker.0 00000100:00100000:1.0:1787853741.389849:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853741.389943:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853741.389945:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853741.389989:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152181504 00000100:00100000:3.0:1787853741.389996:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99264227e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152181760:0@lo:400:kworker.0 00000100:00100000:2.0:1787853741.389996:0:3297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1874700152182016:0@lo:400:kworker.0 00000100:00100000:1.0:1787853741.389997:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152181504 00000100:00100000:3.0:1787853741.390041:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787853741.390059:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152181248 00000100:00100000:2.0:1787853741.390064:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152181248 00000100:00100000:1.0:1787853741.390069:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787853741.390083:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748386940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152181504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787853741.390101:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787853741.390110:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:3299:x1874700152181248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853741.390144:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748386940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1874700152181504:12345-0@lo:400:kworker.0 Request processed in 65us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853741.390152:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787853741.390157:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:606eab1b-a99f-4bb0-a1c7-11b5915f771c+19:3299:x1874700152181248:12345-0@lo:400:kworker.0 Request processed in 48us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853741.390165:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787853741.392989:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152181888 00000100:00100000:2.0:1787853741.393007:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152181888 00000100:00080000:2.0:1787853741.393046:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853741.393088:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152181760 00000100:00100000:2.0:1787853741.393091:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152181760 00000100:00100000:2.0:1787853741.393113:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787853741.393127:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874700152181888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787853741.393212:0:14414:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787853741.393222:0:14414:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787853741.393272:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787853741.393282:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787853741.393289:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dade1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152181760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787853741.393502:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787853741.393574:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99264227e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3297:1874700152181504:0@lo:400:kworker.0 00000100:00100000:1.0:1787853741.393743:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152182016 00000100:00100000:1.0:1787853741.393747:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152182016 00000100:00100000:1.0:1787853741.393894:0:16639:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787853741.393901:0:16639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:2.0:1787853741.396393:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853741.396482:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874700152181888:12345-0@lo:400:kworker.0 Request processed in 3349us (6626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853741.396495:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787853741.396568:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99264227ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3300:1874700152181888:0@lo:400:kworker.0 00000100:00100000:1.0:1787853741.396586:0:16639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787853741.396600:0:16639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874700152182016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787853741.396772:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99264227fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:606eab1b-a99f-4bb0-a1c7-11b5915f771c:3299:1874700152181248:0@lo:400:kworker.0 00000100:00100000:1.0:1787853741.396839:0:16639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1874700152182016:12345-0@lo:400:kworker.0 Request processed in 238us (3331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853741.396846:0:16639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787853741.396903:0:3297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3297:1874700152182016:0@lo:400:kworker.0 00000100:00100000:0.0:1787853741.397287:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dade1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874700152181760:12345-0@lo:400:kworker.0 Request processed in 3996us (7246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853741.397296:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787853741.397461:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99264227e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874700152181760:0@lo:400:kworker.0 00010000:00010000:1.0:1787853741.893875:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787853742.213907:0:14445:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787853742.213916:0:14445:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787853742.213952:0:14445:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787853742.213958:0:14445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787853742.214074:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277c3ccb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14445:1874700152182272:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787853742.214180:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff99276ad4c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787853742.218060:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277c3ccb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14445:1874700152182272:192.168.206.10@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787853742.221404:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853742.221550:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136471552 00000100:00100000:1.0:1787853742.221560:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136471552 00000100:00100000:1.0:1787853742.221645:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:1.0:1787853742.221669:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+24:14510:x1874700136471552:12345-192.168.206.10@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787853742.221786:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+24:14510:x1874700136471552:12345-192.168.206.10@tcp:900:lhsmtool_posix.0 Request processed in 132us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853742.221794:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00080000:2.0:1787853742.222110:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787853742.230269:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853742.230487:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136471680 00000100:00100000:1.0:1787853742.230497:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136471680 00000100:00100000:1.0:1787853742.230709:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:1.0:1787853742.230724:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+24:14510:x1874700136471680:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787853742.230756:0:14414:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787853742.230906:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+24:14510:x1874700136471680:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 187us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853742.230914:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 39 00000100:00100000:3.0:1787853742.239527:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853742.239926:0:16639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136471808 00000100:00100000:1.0:1787853742.239935:0:16639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136471808 00000100:00100000:1.0:1787853742.240012:0:16639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:1.0:1787853742.240024:0:16639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d371ba61-36c8-41b1-a7d1-25796dee8fd1+24:14510:x1874700136471808:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787853742.240090:0:16639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb055e6e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240106:0:16639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb055e6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240179:0:16639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb055e6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240212:0:16639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055e75 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240219:0:16639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055e75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240226:0:16639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055e75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240247:0:16639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055e7c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240256:0:16639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055e7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240263:0:16639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055e7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853742.240297:0:16639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787853742.240302:0:16639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787853742.240313:0:16639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055e7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240325:0:16639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb055e6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240332:0:16639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb055e6e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240340:0:16639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb055e6e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240357:0:16639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196400 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853742.240361:0:16639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb055e6e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240369:0:16639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb055e6e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240382:0:16639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9927433f1700) 00010000:00010000:1.0:1787853742.240385:0:16639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853742.240389:0:16639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb055e6e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240622:0:16639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196400/0xcf1365f7cb055e6e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240640:0:16639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055e75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240645:0:16639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055e75 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240650:0:16639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055e75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240654:0:16639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853742.240657:0:16639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055e75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240663:0:16639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055e75 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240760:0:16639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9927433f1100) 00010000:00010000:1.0:1787853742.240763:0:16639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853742.240766:0:16639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055e75 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240773:0:16639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055e75 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240787:0:16639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055e7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240794:0:16639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055e7c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240800:0:16639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055e7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240806:0:16639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853742.240809:0:16639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055e7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240815:0:16639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055e7c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240823:0:16639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff992742df7200) 00010000:00010000:1.0:1787853742.240825:0:16639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853742.240828:0:16639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055e7c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.240834:0:16639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055e7c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853742.240932:0:16639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d371ba61-36c8-41b1-a7d1-25796dee8fd1+24:14510:x1874700136471808:12345-192.168.206.10@tcp:34:lhsmtool_posix.0 Request processed in 909us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853742.240941:0:16639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 40 00000100:00100000:0.0:1787853742.245834:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853742.245946:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136472064 00000100:00100000:1.0:1787853742.245956:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136472064 00000100:00100000:1.0:1787853742.246027:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:1.0:1787853742.246039:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+24:14510:x1874700136472064:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853742.246057:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853742.246075:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055e83 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd248b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.246235:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055e8a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.246250:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055e8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.246262:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055e8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787853742.246273:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787853742.246361:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055e8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.246370:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055e8a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.246377:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055e8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.246397:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853742.246402:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055e8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.246410:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055e8a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.246422:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff992742df7200) 00010000:00010000:1.0:1787853742.246425:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787853742.246430:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055e8a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.246436:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055e8a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.246478:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055e83 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd248b expref: 26 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.246488:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9927433f1700) 00010000:00010000:1.0:1787853742.246490:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787853742.246493:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055e83 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd248b expref: 26 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.246502:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766197a00, rc 0) 00000100:00100000:1.0:1787853742.246711:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+25:14510:x1874700136472064:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 675us (884us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1787853742.246720:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 41 00000100:00100000:2.0:1787853742.250213:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853742.250294:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136472192 00000100:00100000:1.0:1787853742.250316:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136472192 00000100:00100000:1.0:1787853742.250388:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:1.0:1787853742.250401:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+25:14510:x1874700136472192:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787853742.250436:0:14414:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787853742.250560:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+25:14510:x1874700136472192:12345-192.168.206.10@tcp:53:lhsmtool_posix.0 Request processed in 162us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853742.250567:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 42 00000100:00100000:3.0:1787853742.258766:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853742.259049:0:16640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136472448 00000100:00100000:2.0:1787853742.259057:0:16640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136472448 00000100:00100000:2.0:1787853742.259124:0:16640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:2.0:1787853742.259135:0:16640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d371ba61-36c8-41b1-a7d1-25796dee8fd1+25:14510:x1874700136472448:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853742.259158:0:16640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853742.259184:0:16640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f600/0xcf1365f7cb055e98 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2492 expref: -99 pid: 16640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787853742.259848:0:16640:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:2.0:1787853742.259855:0:16640:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1787853742.259916:0:16640:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1787853742.260182:0:16640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055e9f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.260203:0:16640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055e9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.260216:0:16640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055e9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.260279:0:16640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f600/0xcf1365f7cb055e98 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2492 expref: 28 pid: 16640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.260298:0:16640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055e9f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2492 expref: 27 pid: 16640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.260308:0:16640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff992742df7300) 00010000:00010000:2.0:1787853742.260311:0:16640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787853742.260314:0:16640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99264318e400, rc 0) 00000100:00100000:2.0:1787853742.260369:0:16640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d371ba61-36c8-41b1-a7d1-25796dee8fd1+27:14510:x1874700136472448:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 1235us (1612us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787853742.260377:0:16640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 43 00000100:00100000:0.0:1787853742.264042:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853742.264147:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136472704 00000100:00100000:1.0:1787853742.264156:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136472704 00000100:00100000:1.0:1787853742.264225:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:1.0:1787853742.264236:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+27:14510:x1874700136472704:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787853742.264291:0:14413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787853742.264316:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318e400/0xcf1365f7cb055e9f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2492 expref: 27 pid: 16640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.264336:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff992742df7300) 00010000:00010000:1.0:1787853742.264345:0:14413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787853742.264366:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055ead lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.264378:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055ead lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.264388:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055ead lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.264410:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055eb4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x85caf230 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.264435:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055eb4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x85caf230 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.264444:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055eb4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x85caf230 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.264524:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055ead lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.264533:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055ead lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.264540:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055ead lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.264546:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197a00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853742.264550:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055ead lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.264558:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055ead lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.264568:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff992742df7000) 00010000:00010000:1.0:1787853742.264571:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853742.264575:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055ead lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.264581:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197a00/0xcf1365f7cb055ead lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.264591:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055eb4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x85caf230 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.264604:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055eb4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x85caf230 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.264611:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055eb4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x85caf230 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.264616:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:1.0:1787853742.264620:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055eb4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x85caf230 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.264627:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055eb4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x85caf230 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.264635:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x85caf230 (ffff9927433f1100) 00010000:00010000:1.0:1787853742.264638:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787853742.264641:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055eb4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x85caf230 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.264647:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196200/0xcf1365f7cb055eb4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x85caf230 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853742.269307:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+26:14510:x1874700136472704:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 5064us (5265us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787853742.269320:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 44 00000100:00100000:0.0:1787853742.273885:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853742.273997:0:16639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136472832 00000100:00100000:2.0:1787853742.274005:0:16639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136472832 00000100:00100000:2.0:1787853742.274056:0:16639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:2.0:1787853742.274066:0:16639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d371ba61-36c8-41b1-a7d1-25796dee8fd1+26:14510:x1874700136472832:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853742.274085:0:16639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853742.274103:0:16639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055ebb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd2499 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.274147:0:16639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fa00/0xcf1365f7cb055ec2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.274172:0:16639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fa00/0xcf1365f7cb055ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.274183:0:16639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fa00/0xcf1365f7cb055ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.274272:0:16639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318ea00/0xcf1365f7cb055ebb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2499 expref: 28 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.274290:0:16639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318fa00/0xcf1365f7cb055ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2499 expref: 27 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.274299:0:16639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff992742df7a00) 00010000:00010000:2.0:1787853742.274301:0:16639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787853742.274305:0:16639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99264318fa00, rc 0) 00000100:00100000:2.0:1787853742.274363:0:16639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d371ba61-36c8-41b1-a7d1-25796dee8fd1+27:14510:x1874700136472832:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 298us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853742.274371:0:16639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 45 00000100:00100000:0.0:1787853742.276616:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853742.276981:0:16640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136473088 00000100:00100000:1.0:1787853742.276989:0:16640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136473088 00000100:00100000:1.0:1787853742.277045:0:16640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:1.0:1787853742.277056:0:16640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d371ba61-36c8-41b1-a7d1-25796dee8fd1+27:14510:x1874700136473088:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787853742.277132:0:16640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055ec9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.277158:0:16640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055ec9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.277169:0:16640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055ec9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16640 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787853742.277856:0:16640:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1787853742.277870:0:16640:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 436575196194ns, next at 437575193871ns, rc = 0 00000004:00010000:1.0:1787853742.277959:0:16640:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017b0ecf0 reply state 000000001b755cc2 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055ec9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853742.277969:0:16640:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787853742.278059:0:16640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d371ba61-36c8-41b1-a7d1-25796dee8fd1+29:14510:x1874700136473088:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 1004us (1449us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787853742.278068:0:16640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 46 00000100:00100000:0.0:1787853742.281166:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853742.281235:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136473216 00000100:00100000:1.0:1787853742.281244:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136473216 00000100:00100000:1.0:1787853742.281317:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 47 00000100:00100000:1.0:1787853742.281328:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+29:14510:x1874700136473216:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853742.281348:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853742.281365:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055ed0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd24a0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.281418:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24a0 expref: 30 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.281432:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24a0 expref: 30 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.281467:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff992742df7a00) 00010000:00010000:1.0:1787853742.281470:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787853742.281474:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766197000, rc 0) 00000100:00100000:1.0:1787853742.281538:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+30:14510:x1874700136473216:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 213us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853742.281544:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 47 00010000:00010000:2.0:1787853742.281651:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055ec9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.281660:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055ec9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.281666:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055ec9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.281702:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196c00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:2.0:1787853742.281706:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055ec9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.281720:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055ec9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.281732:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff992742df7a00) 00010000:00010000:2.0:1787853742.281735:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787853742.281738:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055ec9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16640 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.281744:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766196c00/0xcf1365f7cb055ec9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16640 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853742.288218:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853742.288306:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136473344 00000100:00100000:0.0:1787853742.288316:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136473344 00000100:00100000:0.0:1787853742.288375:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:0.0:1787853742.288384:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276dadf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+5:2364:x1874700136473344:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787853742.288750:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276dadf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+6:2364:x1874700136473344:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 366us (542us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787853742.288759:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00080000:2.0:1787853742.289278:0:14409:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787853742.292084:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853742.292190:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136473600 00000100:00100000:2.0:1787853742.292198:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136473600 00000100:00100000:2.0:1787853742.292250:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:2.0:1787853742.292258:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+29:14510:x1874700136473600:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787853742.292458:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+30:14510:x1874700136473600:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 200us (383us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1787853742.292466:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 9 00000100:00100000:3.0:1787853742.294504:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853742.294647:0:16640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136473856 00000100:00100000:1.0:1787853742.294655:0:16640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136473856 00000100:00100000:1.0:1787853742.294751:0:16640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:1.0:1787853742.294763:0:16640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d371ba61-36c8-41b1-a7d1-25796dee8fd1+30:14510:x1874700136473856:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787853742.294859:0:16640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d371ba61-36c8-41b1-a7d1-25796dee8fd1+30:14510:x1874700136473856:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 99us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853742.294867:0:16640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 48 00000100:00100000:0.0:1787853742.302842:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853742.302943:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136473984 00000100:00100000:2.0:1787853742.302952:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136473984 00000100:00100000:2.0:1787853742.303016:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:2.0:1787853742.303026:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+30:14510:x1874700136473984:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787853742.303044:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787853742.303064:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f600/0xcf1365f7cb055ed7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd24a7 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.303172:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f000/0xcf1365f7cb055ede lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.303186:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f000/0xcf1365f7cb055ede lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.303202:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f000/0xcf1365f7cb055ede lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787853742.303237:0:14415:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787853742.303255:0:14415:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f000/0xcf1365f7cb055ede lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.303280:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f600/0xcf1365f7cb055ed7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24a7 expref: 32 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.303298:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f000/0xcf1365f7cb055ede lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24a7 expref: 31 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.303307:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff992742df7a00) 00010000:00010000:2.0:1787853742.303310:0:14415:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787853742.303313:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99264318f000, rc 0) 00000100:00100000:2.0:1787853742.304259:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+31:14510:x1874700136473984:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 1227us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853742.304270:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 49 00000100:00100000:2.0:1787853742.309297:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853742.309393:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136474112 00000100:00100000:1.0:1787853742.309402:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136474112 00000100:00100000:1.0:1787853742.309494:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:1.0:1787853742.309506:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+6:2365:x1874700136474112:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853742.309595:0:15094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853742.309614:0:15094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffc74751/0xcf1365f7cb055ee5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd24ae expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787853742.309638:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a907bae, blocks: 0x1 00010000:00010000:1.0:1787853742.309655:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1787853742.309659:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853742.309698:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffc74751/0xcf1365f7cb055ee5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24ae expref: 7 pid: 15094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.309717:0:15094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ffc74751/0xcf1365f7cb055ee5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24ae expref: 7 pid: 15094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.309730:0:15094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766196200, rc 0) 00000100:00100000:1.0:1787853742.309783:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+7:2365:x1874700136474112:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 281us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853742.309790:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:3.0:1787853742.312564:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853742.312842:0:16639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136474368 00000100:00100000:2.0:1787853742.312851:0:16639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136474368 00000100:00100000:2.0:1787853742.312929:0:16639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:2.0:1787853742.312938:0:16639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d371ba61-36c8-41b1-a7d1-25796dee8fd1+31:14510:x1874700136474368:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787853742.313317:0:16639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d371ba61-36c8-41b1-a7d1-25796dee8fd1+31:14510:x1874700136474368:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 379us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853742.313326:0:16639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 50 00000100:00100000:0.0:1787853742.318562:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853742.318706:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136474496 00000100:00100000:1.0:1787853742.318715:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136474496 00000100:00100000:1.0:1787853742.318781:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:1.0:1787853742.318792:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+31:14510:x1874700136474496:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787853742.381080:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:0.0:1787853742.381094:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:0.0:1787853742.381099:0:5846:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1787853742.381127:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:0.0:1787853742.381145:0:5846:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1787853742.381417:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787853742.381435:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff992748386d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152182400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787853742.381634:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+14:14510:x1874700136474496:12345-192.168.206.10@tcp:44:lhsmtool_posix.0 Request processed in 62842us (63077us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853742.381645:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 51 00000100:00100000:2.0:1787853742.381750:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787853742.382645:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152182400 00000100:00100000:0.0:1787853742.382656:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152182400 00000100:00100000:0.0:1787853742.382740:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787853742.382750:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748385a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874700152182400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787853742.382907:0:15096:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787853742.382911:0:15096:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787853742.382913:0:15096:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787853742.382915:0:15096:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787853742 -> 1787853742 00002000:00010000:0.0:1787853742.382918:0:15096:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787853742.382977:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748385a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1874700152182400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 229us (1227us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787853742.382984:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:1.0:1787853742.383036:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff992748386d00/2, rc 0, transno 8589934595 00000100:00100000:1.0:1787853742.383044:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff992748386d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3300:1874700152182400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787853742.388797:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853742.389216:0:15879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136474624 00000100:00100000:2.0:1787853742.389226:0:15879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136474624 00000100:00100000:2.0:1787853742.389265:0:15879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:2.0:1787853742.389273:0:15879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d371ba61-36c8-41b1-a7d1-25796dee8fd1+7:2365:x1874700136474624:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787853742.389384:0:15879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d371ba61-36c8-41b1-a7d1-25796dee8fd1+7:2365:x1874700136474624:12345-192.168.206.10@tcp:16:lhsmtool_posix.0 Request processed in 111us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853742.389391:0:15879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:3.0:1787853742.391780:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853742.392197:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136474880 00000100:00100000:2.0:1787853742.392206:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136474880 00000100:00100000:2.0:1787853742.392294:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:2.0:1787853742.392305:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+14:14510:x1874700136474880:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787853742.392354:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853742.392378:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f000/0xcf1365f7cb055ede lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24a7 expref: 14 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.392397:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff992742df7a00) 00010000:00010000:2.0:1787853742.392401:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787853742.392507:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f600/0xcf1365f7cb055eec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.392613:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f600/0xcf1365f7cb055eec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.392623:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f600/0xcf1365f7cb055eec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787853742.392884:0:14415:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004714e348 reply state 00000000e1717acd transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f600/0xcf1365f7cb055eec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853742.392893:0:14415:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787853742.393009:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+15:14510:x1874700136474880:12345-192.168.206.10@tcp:36:lhsmtool_posix.0 Request processed in 706us (1236us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787853742.393016:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 52 00000100:00100000:0.0:1787853742.395352:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853742.395499:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136475008 00000100:00100000:1.0:1787853742.395522:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136475008 00000100:00100000:1.0:1787853742.395614:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:1.0:1787853742.395626:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+7:14510:x1874700136475008:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787853742.395642:0:15096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787853742.395660:0:15096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052e141b3/0xcf1365f7cb055ef3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x71822ee510cd24b5 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.395726:0:15096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffc74751/0xcf1365f7cb055ee5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24ae expref: 8 pid: 15094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.395745:0:3283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f600/0xcf1365f7cb055eec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.395756:0:15096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853742.395761:0:15096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853742.395763:0:3283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f600/0xcf1365f7cb055eec lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.395768:0:15096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052e141b3/0xcf1365f7cb055ef3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24b5 expref: 8 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.395771:0:3283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f600/0xcf1365f7cb055eec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.395777:0:3283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318f600 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853742.395782:0:3283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f600/0xcf1365f7cb055eec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.395790:0:3283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f600/0xcf1365f7cb055eec lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.395804:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff992742df7a00) 00010000:00010000:1.0:1787853742.395811:0:15096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ffc74751/0xcf1365f7cb055ee5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24ae expref: 8 pid: 15094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.395826:0:15096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ffc74751/0xcf1365f7cb055ee5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24ae expref: 8 pid: 15094 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853742.395839:0:15096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15096:1874700152182528:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787853742.395879:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853742.395884:0:3283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f600/0xcf1365f7cb055eec lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.395890:0:3283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f600/0xcf1365f7cb055eec lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853742.395924:0:15096:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277bf44d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787853742.397987:0:15096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15096:1874700152182528:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787853742.398051:0:15096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000052e141b3/0xcf1365f7cb055ef3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24b5 expref: 8 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.398076:0:15096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff992766197a00, rc 0) 00000100:00100000:1.0:1787853742.398161:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+8:14510:x1874700136475008:12345-192.168.206.10@tcp:101:lhsmtool_posix.0 Request processed in 2538us (2820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853742.398172:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:0.0:1787853742.400791:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853742.400869:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136475136 00000100:00100000:2.0:1787853742.400882:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136475136 00010000:00010000:2.0:1787853742.400931:0:14400:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ffc74751/0xcf1365f7cb055ee5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24ae expref: 8 pid: 15094 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853742.400991:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:2.0:1787853742.401001:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3cd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+8:2365:x1874700136475136:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787853742.401023:0:14400:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787853742.401044:0:14400:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ffc74751/0xcf1365f7cb055ee5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24ae expref: 8 pid: 15094 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.401058:0:14400:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ffc74751/0xcf1365f7cb055ee5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24ae expref: 8 pid: 15094 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.401100:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffc74751/0xcf1365f7cb055ee5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24ae expref: 8 pid: 15094 timeout: 536 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.401115:0:14400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853742.401120:0:14400:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853742.401126:0:14400:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000052e141b3/0xcf1365f7cb055ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24b5 expref: 7 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.401137:0:14400:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052e141b3/0xcf1365f7cb055ef3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24b5 expref: 7 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.401178:0:14400:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000052e141b3/0xcf1365f7cb055ef3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24b5 expref: 7 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853742.401195:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9927483852c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14400:1874700152182656:192.168.206.10@tcp:105: 00000100:00100000:2.0:1787853742.401283:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffff992775228900 going to sleep for 11 seconds 00000100:00100000:2.0:1787853742.403993:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9927483852c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14400:1874700152182656:192.168.206.10@tcp:105: 00010000:00010000:2.0:1787853742.404017:0:14400:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787853742.404083:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3cd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+7:2365:x1874700136475136:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 3083us (3304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787853742.404095:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 13 00000100:00100000:0.0:1787853742.404636:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853742.405252:0:15879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136475264 00000100:00100000:3.0:1787853742.405263:0:15879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136475264 00000100:00100000:3.0:1787853742.405332:0:15879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:3.0:1787853742.405344:0:15879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d371ba61-36c8-41b1-a7d1-25796dee8fd1+7:2365:x1874700136475264:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787853742.405630:0:15879:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787853742.405634:0:15879:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787853741 00002000:00010000:3.0:1787853742.405637:0:15879:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787853740 00002000:00010000:3.0:1787853742.405639:0:15879:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787853742 -> 1787853741 00002000:00010000:3.0:1787853742.405658:0:15879:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787853742.405943:0:15879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d371ba61-36c8-41b1-a7d1-25796dee8fd1+8:2365:x1874700136475264:12345-192.168.206.10@tcp:2:lhsmtool_posix.0 Request processed in 600us (1367us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787853742.405954:0:15879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:0.0:1787853742.410458:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853742.410640:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136475392 00000100:00100000:2.0:1787853742.410655:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136475392 00000100:00100000:1.0:1787853742.410818:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:1.0:1787853742.410858:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+8:2365:x1874700136475392:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787853742.410929:0:15096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000933ccceb/0xcf1365f7cb055efa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.410954:0:15096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052e141b3/0xcf1365f7cb055ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24b5 expref: 8 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.410964:0:15096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853742.410970:0:15096:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787853742.410975:0:15096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000933ccceb/0xcf1365f7cb055efa lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.411019:0:15096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052e141b3/0xcf1365f7cb055ef3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24b5 expref: 8 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.411036:0:15096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052e141b3/0xcf1365f7cb055ef3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24b5 expref: 8 pid: 15096 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853742.411053:0:15096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99277bc3ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15096:1874700152182784:192.168.206.10@tcp:104: 00000100:00100000:1.0:1787853742.411168:0:15096:0:(client.c:2715:ptlrpc_set_wait()) set ffff99277bf44d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787853742.414564:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:1.0:1787853742.414959:0:15096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99277bc3ed00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15096:1874700152182784:192.168.206.10@tcp:104: 00010000:00010000:1.0:1787853742.415025:0:15096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000933ccceb/0xcf1365f7cb055efa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853742.418226:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136475520 00000100:00100000:2.0:1787853742.418254:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136475520 00010000:00010000:3.0:1787853742.418555:0:14398:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052e141b3/0xcf1365f7cb055ef3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24b5 expref: 9 pid: 15096 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853742.418781:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 14 00000100:00100000:3.0:1787853742.418791:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277c3cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+9:2364:x1874700136475520:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787853742.418808:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787853742.418832:0:14398:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052e141b3/0xcf1365f7cb055ef3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24b5 expref: 9 pid: 15096 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.418855:0:14398:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052e141b3/0xcf1365f7cb055ef3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24b5 expref: 9 pid: 15096 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.418878:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052e141b3/0xcf1365f7cb055ef3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24b5 expref: 9 pid: 15096 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.418893:0:14398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853742.418898:0:14398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787853742.418904:0:14398:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000933ccceb/0xcf1365f7cb055efa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.418915:0:14398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000933ccceb/0xcf1365f7cb055efa lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.418954:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787853742.419026:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+8:2364:x1874700136475520:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 236us (4475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787853742.419034:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 14 00010000:00010000:0.0:1787853742.419365:0:15096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000933ccceb/0xcf1365f7cb055efa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.419376:0:15096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000933ccceb/0xcf1365f7cb055efa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.419399:0:15096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000933ccceb/0xcf1365f7cb055efa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.419406:0:15096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000933ccceb/0xcf1365f7cb055efa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.419423:0:15096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000933ccceb/0xcf1365f7cb055efa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.419430:0:15096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766196400 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853742.419434:0:15096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000933ccceb/0xcf1365f7cb055efa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.419442:0:15096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000933ccceb/0xcf1365f7cb055efa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.419453:0:15096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000933ccceb/0xcf1365f7cb055efa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.419460:0:15096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000933ccceb/0xcf1365f7cb055efa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853742.419549:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277c3cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+7:2365:x1874700136475392:12345-192.168.206.10@tcp:1:lhsmtool_posix.0 Request processed in 8720us (9107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853742.419557:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 16 00000100:00100000:0.0:1787853742.422272:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853742.423257:0:16639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136475776 00000100:00100000:2.0:1787853742.423268:0:16639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136475776 00000100:00100000:2.0:1787853742.423366:0:16639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 53 00000100:00100000:2.0:1787853742.423376:0:16639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99264227e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d371ba61-36c8-41b1-a7d1-25796dee8fd1+14:14510:x1874700136475776:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787853742.423461:0:16639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f200/0xcf1365f7cb055f01 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.423477:0:16639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f200/0xcf1365f7cb055f01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.423488:0:16639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f200/0xcf1365f7cb055f01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.424307:0:16639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf000/0xcf1365f7cb055f08 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.424325:0:16639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055ed0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24a0 expref: 15 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.424345:0:16639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf000/0xcf1365f7cb055f08 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.424381:0:16639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24a0 expref: 15 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.424397:0:16639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055ed0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24a0 expref: 15 pid: 14413 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853742.424424:0:16639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276de1a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16639:1874700152182912:192.168.206.10@tcp:104: 00000100:00100000:3.0:1787853742.424532:0:16639:0:(client.c:2715:ptlrpc_set_wait()) set ffff992758da2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787853742.432318:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853742.432564:0:16639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276de1a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16639:1874700152182912:192.168.206.10@tcp:104: 00010000:00010000:3.0:1787853742.432603:0:16639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf000/0xcf1365f7cb055f08 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853742.433501:0:16528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136475904 00000100:00100000:0.0:1787853742.433520:0:16528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136475904 00010000:00010000:0.0:1787853742.433557:0:16528:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055ed0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24a0 expref: 16 pid: 14413 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853742.433779:0:16528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 15 00000100:00100000:0.0:1787853742.433789:0:16528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d371ba61-36c8-41b1-a7d1-25796dee8fd1+16:2364:x1874700136475904:12345-192.168.206.10@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787853742.433805:0:16528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787853742.433812:0:16528:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055ed0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24a0 expref: 16 pid: 14413 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.433826:0:16528:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24a0 expref: 16 pid: 14413 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.433856:0:16528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197000/0xcf1365f7cb055ed0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.10@tcp remote: 0x71822ee510cd24a0 expref: 16 pid: 14413 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.433878:0:16528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff992742df7a00) 00010000:00010000:0.0:1787853742.433883:0:16528:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf000/0xcf1365f7cb055f08 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.433892:0:16528:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf000/0xcf1365f7cb055f08 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.433914:0:16528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf000/0xcf1365f7cb055f08 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.433943:0:16528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787853742.434002:0:16528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d371ba61-36c8-41b1-a7d1-25796dee8fd1+15:2364:x1874700136475904:12345-192.168.206.10@tcp:103:ldlm_bl.0 Request processed in 213us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853742.434011:0:16528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 15 00010000:00010000:3.0:1787853742.434062:0:16639:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf000/0xcf1365f7cb055f08 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.434077:0:16639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf000/0xcf1365f7cb055f08 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787853742.434255:0:16639:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1787853742.434421:0:16639:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1787853742.434470:0:16639:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1787853742.434553:0:16639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276de1a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16639:1874700152183040:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787853742.434611:0:16639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853742.434641:0:16639:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927463b3000 going to sleep for 11 seconds 00000100:00100000:1.0:1787853742.435012:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152183040 00000100:00100000:1.0:1787853742.435019:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152183040 00000100:00100000:1.0:1787853742.435084:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787853742.435093:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16639:x1874700152183040:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787853742.435180:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16639:x1874700152183040:12345-0@lo:1000:mdt00_003.0 Request processed in 88us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787853742.435187:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787853742.435315:0:16639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276de1a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16639:1874700152183040:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787853742.436169:0:16639:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1787853742.436235:0:16639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276de1a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16639:1874700152183168:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787853742.436286:0:16639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787853742.436310:0:16639:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927463b3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787853742.436333:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700152183168 00000100:00100000:3.0:1787853742.436338:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700152183168 00000100:00100000:3.0:1787853742.436369:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787853742.436376:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16639:x1874700152183168:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787853742.436745:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16639:x1874700152183168:12345-0@lo:1000:mdt00_003.0 Request processed in 368us (457us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787853742.436753:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787853742.436797:0:16639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276de1a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16639:1874700152183168:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787853742.436825:0:16639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf000/0xcf1365f7cb055f08 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.436835:0:16639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf000/0xcf1365f7cb055f08 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.436849:0:16639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf000/0xcf1365f7cb055f08 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.436855:0:16639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992641daf000 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853742.436859:0:16639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf000/0xcf1365f7cb055f08 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.436882:0:16639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf000/0xcf1365f7cb055f08 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.436898:0:16639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff992742df7a00) 00010000:00010000:3.0:1787853742.436902:0:16639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787853742.436906:0:16639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf000/0xcf1365f7cb055f08 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.436913:0:16639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992641daf000/0xcf1365f7cb055f08 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.436942:0:16639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e60 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.436949:0:16639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e60 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.436956:0:16639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e60 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.436961:0:16639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992641dafa00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853742.436963:0:16639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e60 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.437204:0:16639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e60 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.437215:0:16639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff992742df7200) 00010000:00010000:3.0:1787853742.437218:0:16639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787853742.437225:0:16639:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb055e67 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2484 expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.437237:0:16639:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb055e67 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2484 expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.437246:0:16639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb055e67 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2484 expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.437272:0:16639:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff992766197800/0xcf1365f7cb055e67 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.10@tcp remote: 0x71822ee510cd2484 expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853742.437284:0:16639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99276de19e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16639:1874700152183296:192.168.206.10@tcp:105: 00000100:00100000:3.0:1787853742.437452:0:16639:0:(client.c:2715:ptlrpc_set_wait()) set ffff9927463b3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787853742.444970:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853742.445220:0:16639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99276de19e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16639:1874700152183296:192.168.206.10@tcp:105: 00010000:00010000:3.0:1787853742.445248:0:16639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e60 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.445260:0:16639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992641dafa00/0xcf1365f7cb055e60 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.445292:0:16639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055f0f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.445318:0:16639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055f0f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.445330:0:16639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055f0f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.445341:0:16639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055f0f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.445348:0:16639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055f0f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.445356:0:16639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055f0f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.445361:0:16639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992641daea00 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853742.445365:0:16639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055f0f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.445373:0:16639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055f0f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.445384:0:16639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff992742df7200) 00010000:00010000:3.0:1787853742.445387:0:16639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787853742.445391:0:16639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055f0f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.445397:0:16639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff992641daea00/0xcf1365f7cb055f0f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.445406:0:16639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f200/0xcf1365f7cb055f01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.445495:0:16639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f200/0xcf1365f7cb055f01 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.445501:0:16639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f200/0xcf1365f7cb055f01 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.445506:0:16639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318f200 already unused, calling callback (ffffffffc1efd4f0) 00010000:00010000:3.0:1787853742.445519:0:16639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f200/0xcf1365f7cb055f01 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.445526:0:16639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f200/0xcf1365f7cb055f01 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.445536:0:16639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff992742df7200) 00010000:00010000:3.0:1787853742.445538:0:16639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787853742.445542:0:16639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f200/0xcf1365f7cb055f01 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.445547:0:16639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99264318f200/0xcf1365f7cb055f01 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853742.445801:0:16639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99264227e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d371ba61-36c8-41b1-a7d1-25796dee8fd1+18:14510:x1874700136475776:12345-192.168.206.10@tcp:57:lhsmtool_posix.0 Request processed in 22423us (23535us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1787853742.445812:0:16639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 53 00000020:00080000:3.0:1787853742.445818:0:16639:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787853742.445896:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136476032 00000100:00100000:0.0:1787853742.445903:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136476032 00000100:00100000:0.0:1787853742.445946:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 10 00000100:00100000:0.0:1787853742.445955:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992744077050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+18:14507:x1874700136476032:12345-192.168.206.10@tcp:49:dd.0 00000100:00100000:0.0:1787853742.446172:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992744077050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+18:14507:x1874700136476032:12345-192.168.206.10@tcp:49:dd.0 Request processed in 218us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787853742.446179:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 10 00000040:00080000:1.0:1787853742.447143:0:14445:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787853742.447149:0:14445:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787853742.447180:0:14445:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787853742.447188:0:14445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787853742.451017:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:0.0:1787853742.451991:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136476288 00000100:00100000:0.0:1787853742.452003:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136476288 00000100:00100000:0.0:1787853742.452061:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 11 00000100:00100000:0.0:1787853742.452072:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99277bc3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+18:14510:x1874700136476288:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787853742.452748:0:14417:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787853742.452858:0:14417:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1787853742.452900:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9000/0xcf1365f7cb055f16 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.452916:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9000/0xcf1365f7cb055f16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.452927:0:14417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9000/0xcf1365f7cb055f16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.452942:0:14417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9000/0xcf1365f7cb055f16 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.452948:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9000/0xcf1365f7cb055f16 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.452954:0:14417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9000/0xcf1365f7cb055f16 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.452978:0:14417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787853742.453076:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99277bc3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d371ba61-36c8-41b1-a7d1-25796dee8fd1+20:14510:x1874700136476288:12345-192.168.206.10@tcp:35:lhsmtool_posix.0 Request processed in 1005us (2067us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1787853742.453086:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 11 00000020:00080000:0.0:1787853742.453090:0:14417:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787853742.453768:0:14402:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787853742.453776:0:14402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9000/0xcf1365f7cb055f16 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.453785:0:14402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a9000 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853742.453788:0:14402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9000/0xcf1365f7cb055f16 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.453797:0:14402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9000/0xcf1365f7cb055f16 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.453811:0:14402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff992742df7a00) 00010000:00010000:2.0:1787853742.453813:0:14402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787853742.453818:0:14402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9000/0xcf1365f7cb055f16 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.453835:0:14402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9927587a9000/0xcf1365f7cb055f16 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.453849:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853742.453850:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787853742.453852:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787853742.615151:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853742.615266:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853742.615774:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136476416 00000100:00100000:3.0:1787853742.615788:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136476416 00000100:00100000:3.0:1787853742.616049:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136476544 00000100:00100000:3.0:1787853742.616055:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136476544 00000100:00100000:0.0:1787853742.617402:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:0.0:1787853742.617422:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748386580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+8:2365:x1874700136476416:12345-192.168.206.10@tcp:4:dd.0 00002000:00010000:0.0:1787853742.617506:0:15103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a907bad, atime: 0x6a907bac, ctime: 0x6a907bad, blocks: 0x1 00010000:00010000:0.0:1787853742.617536:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd6c1252/0xcf1365f7cb055f1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.617562:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=436s v=(0 0) 00010000:00010000:0.0:1787853742.617576:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787853742.617585:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd6c1252/0xcf1365f7cb055f1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.617603:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd6c1252/0xcf1365f7cb055f1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787853742.622236:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:3.0:1787853742.622317:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853742.622489:0:15101:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787853742.622502:0:15101:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1787853742.622930:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136476800 00000100:00100000:3.0:1787853742.622944:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136476800 00000100:00100000:3.0:1787853742.624195:0:15101:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787853742.624213:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136476672 00000100:00100000:3.0:1787853742.624221:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136476672 00000100:00100000:3.0:1787853742.624505:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:3.0:1787853742.624587:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9927483843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+11:2364:x1874700136476544:12345-192.168.206.10@tcp:4:dd.0 00010000:00010000:3.0:1787853742.624638:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016386f7d/0xcf1365f7cb055f24 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.624661:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787853742.624667:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1787853742.625578:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853742.625620:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853742.625641:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853742.625720:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.10@tcp (source: 12345-192.168.206.10@tcp) 00000100:00100000:2.0:1787853742.625744:0:16644:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787853742.625753:0:16644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00010000:00010000:3.0:1787853742.626535:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016386f7d/0xcf1365f7cb055f24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787853742.626563:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016386f7d/0xcf1365f7cb055f24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853742.627307:0:16644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136477056 00000100:00100000:2.0:1787853742.627319:0:16644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136477056 00000100:00100000:2.0:1787853742.627383:0:16644:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787853742.627397:0:16644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136477184 00000100:00100000:2.0:1787853742.627402:0:16644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136477184 00000100:00100000:2.0:1787853742.627424:0:16644:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787853742.627435:0:16644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136476928 00000100:00100000:2.0:1787853742.627438:0:16644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136476928 00000100:00100000:2.0:1787853742.627454:0:16644:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787853742.627462:0:16644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874700136477312 00000100:00100000:2.0:1787853742.627464:0:16644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874700136477312 00000100:00100000:1.0:1787853742.638238:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:1.0:1787853742.638271:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de19e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d371ba61-36c8-41b1-a7d1-25796dee8fd1+16:2365:x1874700136476800:12345-192.168.206.10@tcp:4:dd.0 00010000:00010000:1.0:1787853742.638311:0:16645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ae47eec/0xcf1365f7cb055f2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.638328:0:16645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853742.638332:0:16645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853742.638340:0:16645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ae47eec/0xcf1365f7cb055f2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.638355:0:16645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ae47eec/0xcf1365f7cb055f2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787853742.729783:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:1.0:1787853742.729805:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:1.0:1787853742.729827:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000001:00080000:1.0:1787853742.729839:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:1.0:1787853742.729903:0:15101:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1787853742.729907:0:15101:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787853741 -> 1787853742 00002000:00010000:1.0:1787853742.729910:0:15101:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787853741 -> 1787853742 00002000:00010000:1.0:1787853742.729913:0:15101:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:1.0:1787853742.729926:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016386f7d/0xcf1365f7cb055f24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.729937:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016386f7d/0xcf1365f7cb055f24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.729945:0:15101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016386f7d/0xcf1365f7cb055f24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.729953:0:15101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992641daea00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:1.0:1787853742.729957:0:15101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016386f7d/0xcf1365f7cb055f24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.729967:0:15101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016386f7d/0xcf1365f7cb055f24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.729987:0:15101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016386f7d/0xcf1365f7cb055f24 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.729996:0:15101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016386f7d/0xcf1365f7cb055f24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853742.730090:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9927483843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+14:2364:x1874700136476544:12345-192.168.206.10@tcp:4:dd.0 Request processed in 105505us (114819us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787853742.730107:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 1 00000100:00100000:1.0:1787853742.730135:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:1.0:1787853742.730152:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99276de1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+13:2365:x1874700136476672:12345-192.168.206.10@tcp:4:dd.0 00010000:00010000:1.0:1787853742.730184:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000223103e5/0xcf1365f7cb055f32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.730196:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787853742.730200:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787853742.730205:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000223103e5/0xcf1365f7cb055f32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.730215:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000223103e5/0xcf1365f7cb055f32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.731709:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd6c1252/0xcf1365f7cb055f1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.731726:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd6c1252/0xcf1365f7cb055f1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.731746:0:15103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd6c1252/0xcf1365f7cb055f1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.731753:0:15103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9927587a9e00 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853742.731757:0:15103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd6c1252/0xcf1365f7cb055f1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.731765:0:15103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd6c1252/0xcf1365f7cb055f1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.731781:0:15103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd6c1252/0xcf1365f7cb055f1d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.731789:0:15103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd6c1252/0xcf1365f7cb055f1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853742.731847:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748386580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+13:2365:x1874700136476416:12345-192.168.206.10@tcp:4:dd.0 Request processed in 114429us (116710us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1787853742.731855:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 0 00000100:00100000:2.0:1787853742.731883:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:2.0:1787853742.731893:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748384f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+12:2365:x1874700136477056:12345-192.168.206.10@tcp:4:dd.0 00010000:00010000:2.0:1787853742.731917:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c17e98e5/0xcf1365f7cb055f39 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.731926:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853742.731936:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853742.731942:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c17e98e5/0xcf1365f7cb055f39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.731952:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c17e98e5/0xcf1365f7cb055f39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.732076:0:16645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ae47eec/0xcf1365f7cb055f2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.732087:0:16645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ae47eec/0xcf1365f7cb055f2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.732096:0:16645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ae47eec/0xcf1365f7cb055f2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.732103:0:16645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197400 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853742.732106:0:16645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ae47eec/0xcf1365f7cb055f2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.732113:0:16645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ae47eec/0xcf1365f7cb055f2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.732125:0:16645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ae47eec/0xcf1365f7cb055f2b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.732132:0:16645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ae47eec/0xcf1365f7cb055f2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853742.732195:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de19e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d371ba61-36c8-41b1-a7d1-25796dee8fd1+12:2365:x1874700136476800:12345-192.168.206.10@tcp:4:dd.0 Request processed in 93944us (109973us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787853742.732203:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 2 00000100:00100000:2.0:1787853742.732219:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 5 00000100:00100000:2.0:1787853742.732227:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748384b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d371ba61-36c8-41b1-a7d1-25796dee8fd1+11:2364:x1874700136477184:12345-192.168.206.10@tcp:4:dd.0 00010000:00010000:2.0:1787853742.732244:0:16645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5e193f3/0xcf1365f7cb055f40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.732253:0:16645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853742.732277:0:16645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853742.732351:0:16645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5e193f3/0xcf1365f7cb055f40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.732363:0:16645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5e193f3/0xcf1365f7cb055f40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787853742.793889:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:2.0:1787853742.798780:0:15101:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 7340032 00002000:00010000:2.0:1787853742.798791:0:15101:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 12295 00010000:00010000:2.0:1787853742.798804:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000223103e5/0xcf1365f7cb055f32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.798816:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000223103e5/0xcf1365f7cb055f32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.798824:0:15101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000223103e5/0xcf1365f7cb055f32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.798839:0:15101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff992766197000 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853742.798844:0:15101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000223103e5/0xcf1365f7cb055f32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.798853:0:15101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000223103e5/0xcf1365f7cb055f32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.798872:0:15101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000223103e5/0xcf1365f7cb055f32 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.798881:0:15101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000223103e5/0xcf1365f7cb055f32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853742.798977:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99276de1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+15:2365:x1874700136476672:12345-192.168.206.10@tcp:4:dd.0 Request processed in 68831us (176656us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787853742.798987:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 3 00000100:00100000:2.0:1787853742.799019:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 6 00000100:00100000:2.0:1787853742.799029:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748387c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+14:2365:x1874700136476928:12345-192.168.206.10@tcp:4:dd.0 00010000:00010000:2.0:1787853742.799058:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f46273/0xcf1365f7cb055f47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.799070:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853742.799074:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853742.799079:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069f46273/0xcf1365f7cb055f47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.799105:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069f46273/0xcf1365f7cb055f47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.842660:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c17e98e5/0xcf1365f7cb055f39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.842696:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c17e98e5/0xcf1365f7cb055f39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.842706:0:15103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c17e98e5/0xcf1365f7cb055f39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.842713:0:15103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318f000 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:2.0:1787853742.842717:0:15103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c17e98e5/0xcf1365f7cb055f39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.842726:0:15103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c17e98e5/0xcf1365f7cb055f39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.842745:0:15103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c17e98e5/0xcf1365f7cb055f39 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.842753:0:15103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c17e98e5/0xcf1365f7cb055f39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787853742.842846:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748384f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+16:2365:x1874700136477056:12345-192.168.206.10@tcp:4:dd.0 Request processed in 110951us (217274us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1787853742.842872:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 4 00000100:00100000:2.0:1787853742.842904:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.10@tcp, seq: 7 00000100:00100000:2.0:1787853742.842916:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff992748346580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+15:2364:x1874700136477312:12345-192.168.206.10@tcp:4:dd.0 00010000:00010000:2.0:1787853742.842947:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001652b65f/0xcf1365f7cb055f4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.842960:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853742.842965:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787853742.842972:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001652b65f/0xcf1365f7cb055f4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787853742.842985:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001652b65f/0xcf1365f7cb055f4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.843401:0:16645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5e193f3/0xcf1365f7cb055f40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.843412:0:16645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5e193f3/0xcf1365f7cb055f40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.843421:0:16645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5e193f3/0xcf1365f7cb055f40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.843427:0:16645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318f600 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:1.0:1787853742.843431:0:16645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5e193f3/0xcf1365f7cb055f40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.843445:0:16645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5e193f3/0xcf1365f7cb055f40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.843458:0:16645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5e193f3/0xcf1365f7cb055f40 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.843465:0:16645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5e193f3/0xcf1365f7cb055f40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853742.843502:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748384b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d371ba61-36c8-41b1-a7d1-25796dee8fd1+15:2364:x1874700136477184:12345-192.168.206.10@tcp:4:dd.0 Request processed in 111276us (217883us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787853742.843524:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 5 00000001:00080000:1.0:1787853742.843550:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:1.0:1787853742.879690:0:15101:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1787853742.879699:0:15101:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1787853742.879713:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069f46273/0xcf1365f7cb055f47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.879726:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069f46273/0xcf1365f7cb055f47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.879734:0:15101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069f46273/0xcf1365f7cb055f47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.879741:0:15101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318e400 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:1.0:1787853742.879759:0:15101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f46273/0xcf1365f7cb055f47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.879769:0:15101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069f46273/0xcf1365f7cb055f47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.879788:0:15101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069f46273/0xcf1365f7cb055f47 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787853742.879796:0:15101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069f46273/0xcf1365f7cb055f47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787853742.879885:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748387c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d371ba61-36c8-41b1-a7d1-25796dee8fd1+11:2365:x1874700136476928:12345-192.168.206.10@tcp:4:dd.0 Request processed in 80854us (254239us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787853742.879897:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 6 00000001:00080000:3.0:1787853742.880240:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00000001:00080000:1.0:1787853742.911098:0:7622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:0.0:1787853742.911363:0:15103:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1787853742.911377:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001652b65f/0xcf1365f7cb055f4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.911389:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001652b65f/0xcf1365f7cb055f4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.911398:0:15103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001652b65f/0xcf1365f7cb055f4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.911405:0:15103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99264318e600 already unused, calling callback (ffffffffc14ad440) 00010000:00010000:0.0:1787853742.911410:0:15103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001652b65f/0xcf1365f7cb055f4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.911418:0:15103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001652b65f/0xcf1365f7cb055f4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.911436:0:15103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001652b65f/0xcf1365f7cb055f4e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787853742.911443:0:15103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001652b65f/0xcf1365f7cb055f4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787853742.911953:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff992748346580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d371ba61-36c8-41b1-a7d1-25796dee8fd1+5:2364:x1874700136477312:12345-192.168.206.10@tcp:4:dd.0 Request processed in 69036us (286228us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787853742.911978:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.10@tcp, seq: 7 00010000:00010000:3.0:1787853742.918347:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787853743.943190:0:14402:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787853744.222006:0:16684:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1787853744.966195:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29073 lines, 29073 kept, 0 dropped, 0 bad.